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ABSTRACT 

The ICD Research Utilization Laboratory (ICD-RUL) at 
the Comprehensive Rehabilitation Center at Catholic University in 
Wasl)ington, D.C. acted as a facilitator for improving management 
practices of supervisors of .Vocationally impaired populations . ^ Over a 
lO-yeaj: span, ICD-RUL developed two National Inforraatiol! Centers for 
disabled public assistance recipients and program evaluation; ^ 
innova^tive service delivery models; and -responses to, national 
utilization neeSis within the areas of its prof iciencijes. Activities 
included the collection of manuals ^and newsletters, mopographs r and 
responses to issues raised by federal and state agency personnel and 
their support facilities. Training seminars in vocational 
rehabilitation and on implementation^ of service delivery models were • 
,conducted. During the latter part of its 10th year/ ICD-RUL 
contributed input on knowledge dissemination- for the Long-Range 
Research Priorities Plan (1980) of the National Institute-of 
Handicapped Research. Recommendations stemming ^rom the project 
include the following: (1) a viable national utilization network 
should be established to offer more resources to rehabilitation 
personnel; (2) change agents in an RUL can quickly fill information 
or procedural gaps; (3) training seminars should be built into the 
funding of an RUL to ensure wider use of information; and (4) a * 
utilization unit s'hould offer options to its users, not solutions, 
with users having the final clvoice of wha-t best fits their programs. 
(Author/KC) / ^ , ' 
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PREFACE 



Research Utilization is predicated on the belief that an idea is only 
as valuable as the extent to which it is applied. Therefore, t^e goal of 
this Final Report is to acquaint ^ its readers with the ICD-RUL's exoerience 
in translating a variety of research and clinical findings into practical 
information media (newsletters, ^abstractSr monographs) and useful service 
delivery formats (service models). A brief historical pei^dective in* 
Section I outlines the national predicament in the mMd-19^s when government 
sponsored research reports piled up. unused. It was then that the need for 
systematic efforts to utilize /this accumi/la1?f ng knowledge-bank led to 
an fhformal network of some 20 researd;^ utilization efforts around the ^ 
country. In this initial network, the ICD-RUt was one of two Laboratories 
situate^^ in comprehensive rehabilitation centers. Its strategies for 
the subsequent ^ten-year effort are summarized in "From Concept To Practice." 

Saction II presents the goals arxl progress of ICD-RUL in overview of the 
first five years (1970-1974) alhd Of the second five year.s (1975-1980). 
Selection of staff, of Advisory and Task Force Committee^ development of 
relationships assignments responding to national and rehabilitation center 
ne^ds, and outcome products are summarized. Sufficient detail is given to 
each activity in order to provide cues to readers far their research 
IJtilization efforts. Section III gives highlights of assessment activities 
relevant to a wide* variety of RUL projects. 

Conclusions and recommendations gained* th<;ough experience by the. RUL appear 
in Section IV, which is followed by Appendices illustrating aspects of 
dissemination procedures and responses. 

* \ * 

During. the latter part, of the tenth year of the grant,* RUL took part in , ^ 
the development of a plan for NIHR Knowledge .Dissemination and Utilization. 
Subsequently, ICD received a one-year extension grapt (1980-19810 to test 
the' feasibility of certair\ aspects of 'this plan. Relevant activities will 
be presented in an Addendum to this report. 
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. ICD-RUL . • ' * * ' " 

A RESEARCH UTJLlZATI-ON LABORATORY ' . 
^ in a s , 

COMPREHENSIVE OlJTPAflENT REHABILITATION CENTER/ ' 

AN RUL IN THE NATIONAL [RESEARCH UTILIZATION THRDST - 

/ * . * , 

When the Research Utilization LaJ)oratory at-ICD Rehabilitation aiyl • 
'Research Center (ICD.-RUL) vas funded^in 1970\ tt added tmpetus to a 
newly developing national interest within the field jof rehabilitation. 

This national utilizati-oh thrust set out" to demonstrate how various 

' * / , * * 

applications of useful research and clinical fipdings could improve- 

existing rehabilitation services^ ICD-RULy supplemeated initial ^ 
utilization efforts, and hovf it augmented the developing national 

^ c 

utilization rfetwork,- reflects the effort to find practical inroads 
through theoretical concepts which hold some promise for improvement 
/^^ the humap condition. ' . ^ ^ 

■ ' ■ . / - '■ 

Historical Perspective ' ^ 

With the passage of the 1-954 Amendments to the Vocational, Rehabili-- . ^ 
* ^ , . ' * ' ' 

^t^tion Act, the 83rd Congress provided fof a. natidnal program of re- : 

se'arch (PL 565, Sec 4). Federal Funds were made available in. this 
research program for projects holding promise of making substantial con- 
^tributions "to the solution of vocational rehabil itation programs common 
to an or several states" By the mid-1960s findings from over 1,300 

research and, demonstration pro^cts were available. Final reports, coming 
in alt a rate of 200 yearly, added to this information bank (2). The " 
need for more systematic efforts to utilize the results of this accumulat- 
ing knowledge-bank ^became apparent to the Social and Rehabilitation 
Services (SRS), then directed by Miss Mary Switzer. It was believed 



.many of tbe research and, clinical reports contained findings which, 
'if used apipropriately, could result in better services for. disabled 

clients. -Therefore, tHfe goal to develop a more coniprehensive research 

^ » • * ' . • i 

^utilization program" in rehabil ttation'developed momentum (3). From 

*th6 iflany discussions and seminars on the potential of research and * 

• * - « 

know! edge 'utilization in rehabilitation, a strategy l^o resolve the * 

problems qf dissemination and utilization was formulated. As a result', 

the Research Utilizatidn Branch under SR5 was established fn 1967. By 

the summer of 19i58, the rdea of demonstration projects emp]oying 

R&^'earch Utilisation Specialises (RUS) in selected State VR^ agencies 

^begai* to <:rystilT*ize. Based on the highly successful model of *a coun- 

, ty AgrjcuTtural Extension Agent , the RU ^ffort was conceive^! as, oper- 

ating as a link between the researcher and the practitioner. Alert to 

the needs of'tfieir freld, and in touch with the latest information * 

pertinent to tl)ose neeVs, the RU personnel could improve communication 

between producers , of kriowledge arvd users of knowledge. By June 1969, 

on,e such ."change a;g§nt" (RUS) was^ established in each of 9 State agen-r 

^es within all SRS geogr^aphic regions, except the Pacific Northwest 

(Region X) (4)-.. 

'.. ■ •••• < ■•■ ■ 

As the number of persons served by State VR |igencies went from the 1959 

{ ^ ' ■■ ^ ' 

leve"] of some 50,000'persons-rehabi3itated to thie 1969 level of 119,000 

rehabilitated (against 386,000 served)*; service providers and program 

administrators found' themselves under increasing pressure to meet the 

^burgeoning service and adminitstrativfe needs. Thus, it seemed to be an 

opportune time to apply the conce'pts'of research util ization in aNpore 

formal and inst1 tu^ onafized manner in* in attempt to respond to the now 

critical need^ of the varigus rehabilitation service providers and 



administrators." Therefore. b^70, some 20 research utilization units 
(including the new ICD-RUL) we^e operating in all relgions of the coun- 
try (5). \i' general, thes.e, 20 units were of four (^stinct types, each 
with its own procedures and techniques, and each ad'dressing the specific • 
needs of. various types of field personnel. (See Figure* I) 
The four types^of units and their target groups were: ^ 

Research and Training Centers (3 in 197&) were university based 
anci essentially oriented" toward the acute restorative aspects of 
rehabilitation. Each center engaged in a variety of research pro- 
jects, both basic and applied and had the additional charge to . 
provide training based on completed work. In most cases, research 
results were communicated to other researchers or practitioners 
.via journal publication and/or training provided at the Center. ^ _ 
Training of joung researchers was provided through the university 

m • 

affiliation. . ' , * 

Regional Rehabilitation Research Institutes (6 in 1970) were also ; 
university based. Some Institutes generally addressed problems in 
psycho-social and vocational service delivery, while others addressed 
management problems or information 'dissemination^ The Institutes 
tended to work closely with State VR agencies. In fact, -they were 
encouraged. to supply expertise and methodologies at the request of 
the^ State agencies in an -attempt to solve their operational problems. 
The result was to be a- body of highly applied knowledge that would 

■v? 

then be communicated to the larger VR community. 



■ . FIGURE 
SRS RESEARCH UTILIZATION ' 
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Research Utilization Specialist (9 in 1970) as indicated above, were 
individuals on the staffs ^f 9-se1ected State VR agencies. The indiv- ' 
iduals so designated served botH the service providers and administrators 
of their respective agencies by accessing research, ^upplyin^ infor- 
mation from a variety of sources, and, where appropriate, interpreting 
completed research that might respond to agency problems. 

Researot i Utilization Laboratories (2 in 1970) were located in private, 
comprehensive rehabilitation centers. Research and Training Centers 
and Regibnal Rehabilitation Research Institutions were to dev'elop 
and djsseminbte new knowledge for the field^, and Research Utilization 
Specialists were to supply and interpret knowledge already developed 
by others. In contrast, the'Research Utilization Laboratory assignment 
was to examine knowledge developed by others, modify it so that it 
could be tpore easily transferred to ongoing service or administrative 
settings, test the modifications for ease of implementation and efficacy, 
and finally disseminate the modified materials afnd offer technical 

* 

assistance and/or training where necessary. Target groups included 
State VR agency service and admini^^trative staffs, the staffs of private 
facilities \hat provide service to State agencies and university programs 
involved with counselor trairiins. 

From Concept to Practice 

Research Utilization (RU) is predicated on the bep'ef that an i;i§a 
is only as valuable' as the extent to which it is~applied. The process is 
a series of methodologies or steps that enable new or under-utilized 
knowledge to provide potential solution^ for very applied service or . 

' * 



managerial problems. FurthermorerRU is based on the assumption that 

this characteristic of applicability can be heightened through utilization 

planning (6). Thus early involvement of some influential potential 

users in the planning, research and development of an innovative procedure 

or practice can often help refine the plan and enhance its likelihood 

of utilization (7), (8). In an excellent overview of the literature, 

Glaser traces the development of the concept that the primary source 

for inoving an innovative idea from the research literature to 

implementation at the service level, is the personal contact with competent 

Research Utilization personnel, who are referred to informally as 

"change agents** or ••information brokers." This person-to-person contact with 

Research Utilization personnel who have access to appropriate knowledge' 

networks, has been found to be superior to such formal communication 

channels as books, journals, speeches etc. (9). It was with this in mind that 

the leadership of ICD-RUL personnel was shared between a, supervisor , ^ 

having a background in interdepartmental rehabilitation education and an Associate 

Supervisor bringing in expertise on. access to data banks and assessment 

techniques. 

As the literature of the 1950's, 1960's and 70's attests, the recoq- 
nition of the need for knowledge utilization is certaMnl^ not new, but 
solutions have been slow in evolving. The idea of locating a Research 
Utilization Laboratory in a comprehensive rehabilitation facility which 
5lso serv-s State VR clients, was conceived as an exemplary site for 
the organizational link between research and practice. ICD Rehabili- 
tation' and Research Center had already distinguished itself in 



developing useful social adjustment and vocational evaluation inno- 
vations. Therefore, the ICD-RUL started in a rich experiential base. 

Due to the advantages, as well as the constraints, of conducting a 
utilization unit in ajlohiprehensive outpatient rehabilitation facility, 
it was necessary to\eview and develop a relevant utilization strategy 
(6). The underlying research utilization strategy which seems to have 
favorably Weathered our 10-year effort, may be briefly summarized as 
follows : 

1. NEEDS IDENTIFICATION & REFINEMENT. A major develo'pment of the 
lab was essentially to enable service programs to relate effec- 

• tively tcy- emerging national priorities. J\s a national priority 
emerges (be it emphasis on a particular type of client, or pro- 
gram, or assessment) State and private agencies and facilities 
lack personnel, time or proper datcl^ base to determine (a) What 
has to be done? (b) 'How to do it? (c) What are the concepts' - 
involved? (d) Ar6 there jfny guides or models to use as cues? 

2. SEARCH AVAILABLE RESOURCES. The Lab scans data banks, in-rorma- . 
tion resources and available programs for materials that m^y bear 
upon the problem. ' , 

3. SYNTHESIS OF PRACTICAL SOLUTIONS. Feasible options bearing 
upon the problem are assembled in .language relating to service- 

application. ; . - ? ^ 

4. PILOT SOLUTIONS ARE TESTED 1% FIELD SETTING. Service personnel ^ 
at ICD and clients involved in programs related ta the Pilot 

have been involved. in its crit;;ique and retesting. Using the in- 
put of ^oth staff and cljents, refinements made by the Lab haye 




been a user-level cooperative effort that resulted in field appli- 

* - ^'^^^"'^ 

cable service innovations. ■ . - ^ - 

• ^ 

5. DISSEMINATION TO OTHER SERVICE SETTINGS. Other service settings, 
Whether public or private agencies, or university training courses 
have been exposed to RUL Service Model via: 

- Publication of Training Materials 

- Training witli on-hand practice at 

- On site technTbal assistance. by RUL staff and consultants 

' The results from the use of the materials at the other sites were 
then incorporated into ^further revisions of the model. Thus, in 

• a sense, the -first-level dissemination was al^o the first-level 
field test. The refined product whi<:h was the;^ result of tITi.s ac- 
' tivity was then disseminated to. the original f-ield sites as well 
as to the general rehabilitation community. 

6; FOLLOW-UP OF UTILIZATION. Via survey, response sheets, loan re- 
cords was an ongoing planned-in component of the project. 

Although part of RUL activity involved abstracting materials on special 
topics, -writing up conference reports, summarizing data searches, etc., 
two .major activity formats evolved from the above underlying Research 
Utilization strategy: Product ServiTS Models and Process Service Models.^ 



PRODUCT SERA/ICE MODELS. One of the early charges given the ICD-RUL 
was to consult with service personnel at ICD and at State VR 
agencies to determine their needs fcg- useful training or for client 
contact materials which' would be relevant to any new 
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national rehabilitation services thrust. Th6n, available research 
and clinical knowledge on that topic was reviewed. If likely tech- . 
^ niques were found, RUL and service consultants (Jiscussed jusfhow the 
material might be modified or presented to fit service needs. The 
theoretical concept was then translated into a- readable^raining 
manual or an audio or audio-visual presentation. 1^is pilot product ^ 
was tested at ICD, as well as at some volunteer State VR agencies. 
Revisions took into consideration their critiques and the final Service 
Model v/as disseminated. Service personnel were trained in its use, 
and we followed up its .spin-off throughout the rehabilitation field in^ 
yearly reports. The Product Service Model was then a tangible tool or 
.technique thot could be directly af)plied at the service level. Examples 
^of PRODUCT SERV-ICE MODELS ARE: ' 

- Leaderless Tapes 

- Placement Preparation Program 

PROCESS SERVICE MODELS . Th^e oth^r; major activity format of ICD-RUL also 
responded to expressed consumer needs 1 When a national priority was 
announced and little precedent existed for its implementation in the 
service field, ICD-RUL assembled a data base and consulted with the . 
appropriate "members of our Research Utilization Network. These consisted 
of existing utilization project leaders around the courN^^in RRIs, 
RTCs and State Agency libraries. When NARIC was set up we enjoyed 
their collaboration, too. Having the RUL established in a private 
iagency with readily available support services (computer, Xerox, typing, 
clerical, audio-visual, mailroom, etc.) and having a small cooperative \^ 
RUL staff geared to quick turn-around time, made production of Process 
Service Models a very feafsible RUL activity. Furthermore, none of our 



hi 



Process Models dogmatically stated any- singular manner in which 
service personnel were to proceeji. ^We alv/ays Organized summary com- 
pilations which would provide the target population of users a choice 
among the variety of approaches thatnvere known to exist on any given 
service problem. The Process S6rvice Models consisted of descripl^ions 
of clinical. or administrative approaches, organizational apporaches,.. 

and descriptions of existing innovative programning . Examples -of ^ 

[ ' % 

PROCESS SERVICE MODEL are: 

- Community Resources: A Multifacet Model for Mentally 111 

- Program Evaluation: A Resource Handbook for, Vocational 

Rehabilitation 

- Conmunity Resources for the Social Adjustment of Severely 

Disabled Persons: Options for Involvement 
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• OVERVIEW OF ICD-RtJL ACTIVITIES 

'< • . 

NIHR Project #22-P-5aO-eO - 
. (^&D 3374 RU 70) 4 ' 

.Recognizing that a fair body of knowledge dev<ited to the principles and 
practices of research diffusion and utilization, was already, at the dis- 
posal of the SR^' Research Utilization Branch, establishing a Research / 
utilization laborator/y was one practical way to effect wider use of 
research results within ongoing jjehabilitation operations. 



^.r THE FIRST FIVE YEARS: PURPOSE & PROGRESS 

' ' V. 

(April 1 , 1970 - May 31 , 1975) 

In April 1970, the ICD Rehabilitation and Research Center received an SRS 

grant to set up a Research Utilization Laboratory (RUL). The laboratory 

• was to act as a catalytic interface between research and implementation. 

The purposes of this laboratory vyere to: 

- Identify effective research within pertinent categories and adapt 
these findings to the service operations of the Institute. 

- Serve as a source of information to other rehabilitation centers on 
^ experience encountered in applying the results of research. 

- Evaluate the program and develop an effective method for the diffu- 
sion of igno^ion and for the "transferability" of findings useful 
to rehabilifetion practi'^ioners . 

' - Foster close collaborative consultation on research utilization with 
public and private agencies in the immediate coinmunity and in a proxi- 
y mal^egional area.- ^ 

- Participate in a con^^ed national effort to maximize the applica- 
* tr^ns of research by the Research Utilization Branch of the Division 

of Research and Demonstration Grants in the Social and Rehabilitation 
service. . * 

ERIC 



ERIC 



-A V , 

These five purposes were seen as being inter-dependent. As "phange 
agents", the Perspnnel of tffe Research Utilization Laboratory were to 
be responsible to, as well as supporting of, the potential contributii)n 
within all inter-acting agencies. 

YEAR ONE (April, 1970 - May 31, 1971 
Project activity during the initial year was largely developmental. Major ^ 
concerns were development of^taff apd consolidation of relationships with 
external and internal entities. The 'errst yeSn activities may be summarized 

as follows: — ^ 

, Staff Selection and Development . The Institute Director .delegated to 
the Project Supervisor the responsibility fro the conduct of the RU 
Laboratory. In the selection of the Project Supe||^visor, stress was placed on 
knowledge of the dynamics of change and research utilization. Some- 
One with interdisciplinary skills was sought who could work closely 
with ICD department heads, as well as with the potential research utili- 
zation collaboratf>rs in pri^vate and public a'genries and with universities 
in Region II. Isabel P. Robinault, Ph.D., was Appointed in October 1970. 
Search for an Assistant Project Supervisor was initiated in December and 
Marvin Weisinger was appointed in February 1971, addina his technical 
operation skills to the RUL staff. 

t 

Development of Relationships . The Project Supervisor met with personnel 
of the Research Utilization Branch of SRS once a month to gain an overview 
of resources available at the Central Office and^to discuss areas 
* of interaction. Subsequently, the Director and the Project Supervisor 
followed-up SRS discussions and met with representatives of Division 22 
of the American Psychological Association (Rehabilitation Psychology). 

9^- • . 



13 



"Accordingly,- a meeting was held December 4th with Herbert Zaretzky, then 
Divisi^onal Chairman, who confirmed Division Zi's interest in a joj^nt 
seminar on ' Research- Utilization and Disabled Disadvantaged Clients." 
A committee was organized *o work on date, location, attendance and pos- 



sible fundtrig for^this. 



At this tima, conferences on the Research Utilization Laboratory's objeQ- 
lives^and 1;he development of a RUL Advisory Coimittee were also held with 
Anthony DiSimone, Regional Coimissionfr for Rehabilitation. Services, and 
with Andn'ano MariYielli, RU Specialist, Rehabilitation Coinmission, State 
of New Jersey. 

These contacts with outside res6urces were in addition to the intensive * 
and ongoing development of relationships betw^eSn the RUL and the ICD staff. 
Many staff and organizational changes have taken place at ICD since the 
Project Supervisor had been there some six years previous'^'t^^e RUL project 
Therefore, October was spent meeting new staff. in all departments. By 
November, the Project Supervisor? was invited to participate in the weekly - 
meetings of the Institute's .five interdisciplinary case-review Teams, which 
are attended by DVR counselors. This was a particularly rewarding develop- 
ment since the eventual success of the Laboratory would rely upon whole- 
hearted cqoperation of ICD staff. 

Also, -the reception of the Trustees of the Institute to the Project Super- 
visor's lecture discussion abou»t the RUL Laboratory was warm. Questions 
evildenced interest and cooperation in furthering this project. 



1j 
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Selection 'of an Advisoj-v Committee* 

As avresuU of the Regional discussions mentioned above, it was decided 
that the establishment of an- Advisory Committee would ^substantially aid 
the project. If the committee was appropriately constituted, not only ^ 
could it provide guidance but it could also increase the project's credi- ' 
bility in the eyes of potential consumers of prdject-deve^oped materials! 
Ideally, such a committee should include representatives from the Federal 
establishment. State Agencies, educational institutions, ^nd private 

facilities. * 
. • ••. 

> ■ • 

After consultation with rehabilitation specialists in. the area and in 
Washington, a lette'r of invitation was sent to 12 rehabilitation leaders 
representing: the Regional SRS -office, two State Rehabil i^tion offices,'' 
four Rehabilitation Centers, one Special Education Program, two Commumty 
Programs and two Universities with training for professional persons in 
rehabilitation. Its first meeting was held in early March. The final 
committee was comprised of the following: 



Mr. Domingo Collazzo 
Assistant .Secretary 
Vocational Rehabilitation Program 
Department of Social Services 



Mr. Anthony S. DiSimone 
Commissioner for Rehabilitation 

Services, Region II 
Social & Rehabilitation Service 



Dr. Martin Mo^ 
Assistant to the President 
Fiorello H. LaGuardia Community 
College 

The City University of New York 

Dean Warren Perry til 

School of Allied Health Prdfessions 

State University of New York 



Dr. Helen Donovan Feulner 

Office of Special Education 

New York City Board of Education 



Miss Janet Pinner, Director 

Special Placement Services 

New York State Employment Service 
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Dr^ Max Dubrow, Director 
Association for the Help of 
'Retarded Children 

Father f^ranco LoBianco 
Mt. Xarmel Guild 
Arthdiocese gf Newark . ^ ^ 

Miss Marion Martin, Administrator 
Vocational Rehabil itatiOn 
Rehabilitation Facilities Division 
State of New Xork 

♦ 

As thus constituted, the Advisory Coimittee had an active role 1n recom- 
^mending projects to be undertaken and assigning priorities, plus guiding 
and follow-through on utilization of practical findings at ICD and at its 
collaborating public and private agencies in Region II. 

* 

SRS Research Information System 

In January 19:jl, the '*SRS Information System," established by the Research 
Utilization Branch of SRS, began its fourth official month of a six-month 
test. The "SRS Information System" was basically a data base which con- 
sisted of all reports of projects funded' by SRS R&D. It comprised abstracts 
of all reports, microfiche copies of the full reports and a set of "locator 
cards" - a coordinate index by m^ans* of which the collection could be 
searched through the use of sets of key words. 

At this time, the RUL felt it could assist in gaining a concensus on im- 
proving dynamic ways of incorporating the system into Research Utilization 
projects around the country. The RUL project supervisors and key staff of 
the Research Utilization Branch of SRS conferred on the form and nature of 
this potential -assistance. A workshop format was decided upon and the RUL 
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Mr. Jay Schleikhorn 
Executive Director 
UCP of New Ydrk State 



Mr. Joseph Weinberg 
Jewish Vocational Service 



Mr't Henry Williams ^ 
Director of Rehabilitation Services 
Manhattan State Hospital 



devised -a questionnaire to the field test statipns, the>esult of fihich 
provided the factual basis for beginning workshop tasks. Invitations 
were. then extended to the 25 individuals, then actively involved in the 
field tests. 

On March 3-5, 1971, the twenty-five participants met at ICD and through a 
series of intensive workshops shared their, experiences from the initial 

'field tests> developed a number of potential models of an information sys- 
tem and prepared a list of recommendations for future efforts. It was 

.also agreed' upon that the field test sites would engage in a series of 
cooperative actions based upon the recommendations-, and the results of these 
actions would be evaluated and reported upon at some future workshop. In 
effect, a secondrstage field trial was undertaken. / 

The^RUL applied for short term training funds^ These were granted 
(44-P-10160) and two additional workshops were held. The first (Phase I) 
.workshop was held January 10-lT, 1972^nd included a detailed discussion of 
the results of the second-stage field trial and further recommendations. 
Final field trials were developed and initial writing assignments for a 
proposed instltction manual for the Information System were made. 

The final workshop (Phase II) was held on June 12-15, 1972. The major ac- 
tivity was the preparation of drafts of the instruction manual as modified 
by field experience.. The R\}1 staff then thoroughly re-edited tfie materials 
and they were published by SRS as "A Guide to the Use of the SRS Research 
Information System - Instruction Manual" (SRS 73-05653). 
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Clarification of F^cus 

At the March'n-12th meeting of the RU Advispry Committee, the discussion 
centered abo'^ut clarifying the "change agent " responsibilities, of the Lab. 
Accordingly,. the Committee suggested that ICD-RUlx^uld make it^ major 
thrust the REHABILITATION OF SPECIAL CLIENT POPULATIONS. Subsequently, a 
Task Force of national and regional representatives of SRS and the Commu- 
nity Services Administration (CSA) met at ICD on April 22nd and 23rd to ^ 
^iscuss the nature of these "special client populations**' and how ICD-RUk 
could become responsive to emerging national priorities and state agency 

needs. The task Torce was comprised of: ' ' ' 

/ 

Margaret Clark, Consultant 
Short-Term Training, SRS 



Anthony DiSimone, Director, 
SRS J Region II 



George Engstrom, Director 
^^Research Utilization Branch, SRS 



Wesley Geigel, Chief of Facilities, RSA 



Helen Hamer, Chief 

Program Development Branch, CSA 



Fred Sachs, Chief 
^Division of State Plans 
^Projects and Grants, RSA 



Milton L. Shurr,- Program Analyst 
PA Expansion Projects, RSA 



Joseph Steigman, Adult Services Specialist, CSA 



Miriam Stubbs, Chief 

Prograft) Planning and Development Branch, RSA 
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Much consideration was given to the Expansion Grant Program of SRS , ' . 
which had its objective for FY 1972 to serve 45,00a public assitance 
clients and to rehabilitate an additional &,OOO.such clients over the ■ 
prevailing rate. Consequently, ICD-RUL accepted the .recommendation to 
explore how the Lab activities might be relevant to specific VRA objec- 
tives for DISABLED PUBLIC ASSISTANCE RECIPIENTS. The grajit proposal for 
the second grant year therefore, included the following five thrusts ' 
relevant to the Public Assistance/Vocational Rehabilitation (PA/VR) emerg- 
ing national priority: 

1) Act as a field t^st station for PA/VR and related Service Models 

2) Organize a National PA/VR Information Center 

3-) Train (under separate Training Grant requests) in information dis- 
semination procedures for the SRS Research Informatioh System etc. 

4) Develop training materials pertinent to the PA/VR national expansion 
qrant effort 

5) Act as resource consultants for a variety of special needs of the 
SRS central office and the RQ network (RTCs, RRRIs, RUSs etc.) 

During remaining months of this first year, the Project Supervisor and 
Assistant Supervisor continued to strengthen relationships with the staff 
through consultations on research utilization related to ongoing client pro- 
grams, as well as plan to implement priorities indicated by the Advisory 
Committee. Interagency and university contacts broadened and increased in 
depth, due to the added -technical skills of the A^stant Project Super- 
visor. 
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YEARS TWO TO FIVE-THE PA/VR PROJECTS 

(1971 - 1975) , ■ ■ . 

Training for National Priorities. . 

la response, to the Advisory Committer recommendations and,PA/W Task Force 
discussions, ICD-RUL applied for its first PA/VR Short-Term Training Grant, 
April, 1971. A series of training conferences and trainjing materials 
evolved with the purpose of bringing together those factors and elements 
thought to be vital for the development of successful P^/VR Expansion Pro- 
jects and subsequent national efforts in rehabil itatio^ of disabled public 
assistance clients. "The first conference under SRS 4^^-P-10160 was held 
May 24- 28th, 1971. The objective was to provide training and guidelines 
to give technical assistance which would improve interagency cooperation 
(VR, Welfare, Labor, CSA) at Regional and State levels. Prior to the May 
meeting, the RUL reviewed the literature and assembled packets of selected 
information which enumerated all possible components for model building. 
These were distributed to 25 selected National, Regional and State repre- 
sentatives frbm CSA, Welfare and Vocational Rehabilitation. During the five 
days of the meeting, these resource packets were used as the basis for 
initial drafts of the training materials. The RUL did a further editing of 
these drafts, assembled them into a preliminary two- volume training document 
A national Training Conference was then scheduled for September 13-17, 1971 
and copies of this draft training manual were distributed in advance to the 
110 State, Federal and Regional participants. At the meeting, participants 
reviewed the materials and made recommendations for improvements. Many of 
the attendees, however, found the drafts sufficiently complete to make im- 
mediate use of them. Subsequent to this meeting, the RUL assembled and 
edited the critiques from the participants and collaborated with the SRS 
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Task Force members in Ptiblishing Guide Materials for Expansion Grant . 
Projects in January, WJ2 <4). This publication was distributed nation- 
ally through the centra-1 office of SRS and the RUL Information Center. 
The document waslvery popular and the supply of 2000 copies was quickly 
. exhausted. ^ ^ • / ^ ^ ^ 

- At a July 6-7th Strategy Session, the PA/VR Task Force indicated the ^ 
need for updating PA/VR .information and developing NationaT PA/VR training 
cadre. This up-daie would be based on the results of the first year of 
opera'tion-^and would be partially accomplished by publishing a training re- 
port useful to State Agency personnel focusing on innovative and producti3/e 
approaches culled from a nationwide experience within the PA/VR effort. 
. Accordingly, Short-'T^rm Training Grant #45-P-l 01/2-01 was extended to 
March7l973 to cover a Planning Session (September ,21-22, 1972), a Natipnal 
PA/VR Training Conference (December 6-8, 1^72) and the development, and pub- 
lication of a training documen^t. Prior to the^meeting, a comprehensive 
• questionnaire was distributed to-~77 Expansion Grant, Projects. Responses 
and documentation from this survey provided the basis for position papers 
on Expansion Grant Policies and Practices. Sixteen individuals, including 
Federal consultants, then drafted ■ papers 'on key PA?VR issues 'awhile another 
twelve prepared papers which ^up-dated Expans:ion Grant results. 'Draft ma- ^ 
^terials were reproduced and mailed to all potential partjc^ipanTT^or input 
of practical program-oriented examples. The 10 HEW regions 6ach sent 5-9 
representatives from both PA and VR to the December Conference.^ Of the 119' 
participants at the December meetings, one-half represented PA Agencies (up 
from 1/3 in 1971) and PA representative was among planners, speaker"^, pandi 
members and work-group leaders. Some 48. of the 119 participants were in- 
volved in conference procedures as panel members, workgroup leaders, or 
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resource personnel. The Publication Comm1ttee\lCD-RULi Central Office 
Consultants and Editorial Consultant) met directl\ after the Conference 
to organize draft revisions and responsibilities pertinent to a final re- 
source training document. Since RUL was able to undertake a major part 
of editing, the unexpended outside editing funds, made it possible to pro- 
duce two (5) (6), rather than one, product from the same budget 



5,000 copies PA/VR Policies & Practices - Resources for Training, 
March, 1973. - 



2,000 copies PA/VR Policies & Practices - Manual of Joint Forms, 
May, 1973. 



PA/VR National Information Center 

Upon the advice of our Advisory Committee and PA/VR Task Force, ICD-RUL 
added a May,. 1971 Supplement to its core project^application, requesting 
to Establish a National PA/VR Information Center: 

- To support the Expansion Grant Projects in*the rehabilitation of 
disabled PA client 

- -To-assisX State agencies in entry into the data base required to 
develop comprehensive PA/VR service progfram ^ , 

- TO'.prpvide information concerning research findings to public^ 
, officials and agencies concerned with rehabilitation of the PA 

client 

- To ultimately provide information concerning research and field 
• findings on PA recipients to any qualified person requesting- it 

'r- " > ■ / ■ 

ICP allocated additional space for this, the Associate Supervisoj^ was 
given, administrative sup'^ision of the neV/'lictrvity and the first Infor- 
mation Techniciq[n was hired in September, 1971. 

22 '^'^ 
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The Information Center was to acquire any documents relevant to the PAt'VR 
effort. Major emphasis in acquisition was placed on documents that were 
not published (State reports, position papers or State or Federal internal 
reports ) or ^ocuTients that were7elTtTveTy~diff icul t -to"f"etrlBV&-r "tn -ad- 
dition, the collection was not to be limited to the field of VR but could 
originate from any discipline which had relevance to the Expansion Grant 
effort. 

I 

Once acquired, documents were cataloged in-depth and then selected, for 
inclusion in two regularly issued publications: the first, a bi-monthly which 
provided short non-evaluative abstracts and the second, a yearly which was 
basically a topically arranged holdings list. Th'ese publications were cir- 
culated to persons involved with PA/Vr activitiel. Documents listed could 
be then borrowed by mail free of charge. (See Fiaure II) 

Activities 'for th*e duration of the remaining four-year grant period included: 
Acquisitions & Holdings 

Initially, a concerted effort wa^ made througFTVederal and State person- 
' nel to collect Expansfon Grant applications, and progress reports. A 
questionnaire circulated in August 1972 to 77 Expansion Grant Projects^ 
brought in a wealth of resource documents, such as cooperative agree- 
ments, joint foms, training guides,- etc. Other holdings related to 
PA/VR objectives included reports, monographs, journal articles. Inter- 
nal State Agency documents, and research reports and documents from 
Federal Agendies other than RSA. As a result, December holdings of the 
Information Center went from 150 items in 1971 to over 2,700 in 1974. 
In 1974, we also added an j'nteractiye computerized data base retrieval 
system (Dialog). • 

♦« , 23 - . 
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FIGURE II 

RESEARCH UTILIZATION LABORATORY 

INFORMATION CENTER 

ICD REHABILITATION AND RESEARCH CENTER 
340 EAST 24tlrSTRE&T, NEW Y0RK, N Y. 1G01O (212)-679-010Q 





Services 
Now Available 



intotmMiiOn 
lt«tourc«t 



PA vn 

Oocomtnj 



Trcming 
Mcnutit 



Resource t 



ERIC 



2) 



30 



PA/VR Newsletter 

Although the original time-frame allowed 8 months for acquisition and 
^ 8-18 months for dissemination to build up. it was felt that dissemination 

should begi^-«-soon-as possible in order to '.supportjew state grant 

applications. Therefore, the first issue of the PA/VR Newsletter was cir- 
culated in December 1971 to ^200 individuals. Subsequent issues reached a 
circulation of "1,000 in December 1972 and 1,844 by December 1974. This 
total circulation proved optimal' for the staffing provided under the grant 
(3).- 

Each 8-12 page PA/VR NEWSLETTER contained abstracts of new acquisitions, 
with an order form on the last page. To borrow copies of items listed in 
*the newsletter, applicants merely had to circle the catalog number of the 
item and return the order form to the Information Technician. Items were 
^n loan for fi.ve working ^days after receipt. During the fourth and fifth 
years of the grant, items related to the program evaluation and research of 
services to disabled public assistance clients found a welcome response 
from PA Personnel in State VR agencies, representatives from the Department^ 
of Labor and State Employment Services, as well as Federal personnel at RSA 
central office and Regional offices. 

♦ 

, , ■ Items Circulated , frrxn Inform^ion Center went from 780 in 1972 to 1,444 in 
1974 - as a result of 188 requests in 1972 and 497 requests in 1974. 

Users came from all 50 state§. Federal regional offices, Puerto Rico and 
Washington^ DC. The number of users went from 128 in 1972 to 401 in 1974. 
Repeat-users rate has gone from 32% in FY 1972 to 19.8% in 1974, indicating 
the large incVease in requests represented a substantial number of new users 
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Additional details will be found in Section III. ' ^ 

Special Projects 

,a^._ Jfldepta^e, 20 miputes. Functions of RUL - highlighting the Informa- 
tion Center. Produced by RUL January 1972. Distributed to R&D 
Specialists training meeting in Washington, D.C., New Jersey: RUS, 
for Region I training meeting; IRS meetings. 

b. Specialized bi^bl iographies were prepared in response to request in- 
cluding inajor input to Prime Study Group on PA/VR of Institute of 
Rehabilitation Service Training Workshops at ICD* 

c. Information Center slide-synch presentation, 3 minutes: detailing use 

• of the Information ^Center, produced Spring 1973 and shown at APA Divi- 
sion 22 meeting. 

Innovative Service Delivery Models 

Leaderless Groups: A Tape Cassette Technique for Vocational Education 
In response to the need of ultimate users (State counselor) for in- 
novative techniques to handle larger caseloads, relate to PA/VR clien- 
tele, and improve service, del > very while involving clients in the pro- 
cess, ICD-RUL surveyed relevant group research* One RSA funded research 
project seetnecLto show signiffcant promise. Western Behavioral Sciences 
Institute had developed a leaderless group technique that was being mar- 
keted as the Vocational Education Encountertapes of the Human Develop- 
ment Institute. These tapes were underused, however, -and were unknown 
to VR. counselors. Therefore, RUL translated the counselor need into a 
problem statement:, What were the positives to be retrieved from these 
' tapes? We attempted to answer the question by encpuraging counselors 
with PA/«VR groups to critique the tapes. The subsequent diagnosis 
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^indicated a need for more reference to vocational rehabilitation problems 

\ 

iiVeach tape and suggested gearing tapes to. decision-making procedures 
rather than to interpersonal encounters, which could not be held within* 
bounds by the avtrage counselor. The required modifications involved 
-rewriting the script"*Si^ adapting the languaae-used in the' subsequent 
audio-tapes to the parlance of PA/VR clientele. ♦ new set of tapes were. then 
produced.^ A successful -in-house tryout prompted us to attempt wider dis- 
semination. Through a short-term' training grant, (45-P-81067) state 
agency training and program personnel participated in the group process re- 
quired to train counselors at the service level in use of the tapes. Twenty 
tape-cassette sets were distributed among HEW regions for trial. Additional 
trials were offered to counselors reached through the PA/VR Newsletter 
who were willing to join the utilization project by signing a commitment 
statement that guaranteed both a client-derived critique and a counselor 
critique of tapes. Results of this training and of the State implementation 
trials were reported in a publication (1) (2). 



MICROTOWER Group Vrocess & PA/VR Populations 

A survey of rehabilitation facilities in Region II was initiated by 
RUL and completed in March, 19^2. Coirinents from facilities, who either 
did not use the TOWER system or used it in a greatly modified form, 
pointed up some of the difficulties encouraged infits use with PA clients. 
These observations, together with additional pointers retrieved from the 
relevant literature indicated: 

a. the tasks, as presently cons"truct3ci, required a- reading level beyond 
capability of many of the disadvantaged clients 

b. tfre entire series of TOWER work^ task& take far too long for admini- 

« 

^ strati on (20-25 days) in fact, studies have indicated that the drop- 
>— otit rate with an evaluation of this length is highest among those 
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disadvantaged cl/ients.who are the brightest and*have-the greatest 
rehabilitation potential 

the equipment required for implementing the full battery of TOWER 
tasks represents a considerable expenditure of ^'unds^'or^-faci-l+ty 



d.T^was fe.lt by many that the f^l^esent TOWER tasks are too locked to 
• specific occupations and do not permit sufficient generalization to 
occupational areas. TJius, the tasks had to be modified or new 
tasks developed to respond to local conditions and needs 

As -members of the TOWER research advisory committee, the senior RUL staff 
brought these consents to the atte^ition of Dr. Ferison, Research Psycholo- 
gist conducting the project, and piqued a significant role in the planning 
and implementation of the resear^. , The^ollowing criteria were reached 
ahd research implemented^ / . 

- The new work-task battery (designated "MICRO-TOWER^') would require 

"a maximum »of 5 days to administer. This should substantially decrease 
the drop-out rate. / . • 

- Only tasks requiring an absolute minimum of specialized equipment 
^ouldtbe considered in order to cut costs for implementation in 

_ rehabilitation facilities. 

TasTcs selected would be>elated to a series of aptitudes keyed to the 
Dictionary of Occupational Titles (D.O.T.) rather than specific 
occupational areas to make the evaluation more generally useful. 

- Ease of admi>iistration was considered, an important criterion. There- 
fore, the task instructions will be considerably simplified so that 

-verbal presentation of the' instructions would be possible. A-V 
techniques and a Spanish translation are being considered. 
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While the RUL staff served on the research conmittee which monitored the 
entire project, the RUL also had the specific responsibility for develop- 
ing the format for a series of cl^nt group sessions , part of the total 
evaluation packag e. It was the purpose of these 'essions to elicit 
client 'reactions to work and to the evaluation proctss thereby helping . -v 
clients to develop an understanding of the purposes and benefits of job * 
evaluation. , ' ^ 

On completiofv of the RUL component of the MICRO-TOWER battery, ICD ran 
field trials of the total package and ultimately marketed the final product. 

Placement Preparation Program 

In response to inquiries concerning programs for job placement and iob^ 
retention, during the 5th grant year, RUL examined many of the avail- 

• able materials and discovered no truly comprehensive package for this. 
The research literature emphatically states that, people tend to lose 
jobs, not because of poor skills, but mainly because they lack ability 
to relate interpersonal ly with supervisors and peers and have a. limited 
ability to conform to non-skill related work requirements. Other 
studies /indicate that the disadvantaged have difficulty getting jobs on 

/ their own. A study in Region VII showed that getting a job on one's own 
was the second most effective method of obtaining a job, but most' 
PA clients do not possess the requisite skills. 

While training packages did exist,. each lacked something. There was a 
package for didactic training on how to write an application or respond 
to an interview, but this neglected the interpersonal aspects of work. 

Other packages did the reverse. In addition, these, packages were not 

necessatrily group work programs and we found that in group situations, 



clients reflect, support and respond with a wealth of information that 
they do not have an opportunity to do in didactic training session. RUL 
attempted to take the best of all programs - presint the material in a • • 

; dynamic forma't to encourage motivatfon, - and come out with a comprehensive 

audio-visual package covering all aspects 4f job placement and job reten- 
tlon training. In addition, and perhaps most important, the Placement • 
Preparation Program was to include an aspect of work readiness that is 

generally ignored in most-other^pru3g^r^ms^-Jha4:^as--tbe-E^ of motivation 

or "why go to work at all?;' Admittedly, this was a difficult factor to in- 
clude in such a program without the material engaging in overt propagandiz- 
ing (an approach which tends to evoke the suspicions of many of the disad- 
vantaged). The first unit of the program, tentatively titled "Why Work" 
* was produced as a 20-minute videotape and tested on several client groups 

^ " with excellent results. The purpose of this unit was to initiate discussion 

among group members v/ho had never met and to begin to help them express 
th^ir own feelings and fears about going to work. The groups ranged from 
highly verbal Re]i^^^i^Trt|tion Aide Trainees to workshop clients of borderline 
intelligence. All group members were socially and economically disadvantaged 
■ , The material stimulated discussion and valuable insights into clients' feel- 
ings and motivations were obtained. With this encouragement, RUL planned to 

make completion of the PPP, one t)f its top priority items. 

/ 

Policy Implication Papers: PA/VR 

On November 13, 1972, ICD-RUL attended a Division of Research Ufilization 
« (DRU) planning meeting. Also present were ^representatives of University of 

, ■ Florida RRRI, JVS/RUL (Chicago) and^DU(C1^veIaDd)-.^^_Pliui S were out Vjned^^ 
for developing Policy Implication Papers addressing selected bureau office 
operations (policy regulations, guidelines, legislation). Of topics sugges- 
O . ted in the January 1973 DRU memorandun, ICD-RUL chose "Effective Service 
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Delivery Strategies for PA clieAts in Rehabilitation Facilities." A 
digest of the draft report was presented in April 1973 to members of ICD 
Board of Trustees who expressed thanks for insight into this population. 
wh-1ch--has been referred to private facilities only in recent years. The 
semi-final. draft was sent to DRU in July, 1973; the revised paper incorporating 
suggestions from the central office in Washington was sent to DRU in 
September, 1973. 



Change Agent Outreach 

As part of its utilization mission, the RUL provided materials and speakers 
to groups having separate funding, whenever these groups could profit from 
information concerning research utilization or the PA/VR programs. For 
' example: 

- A 3-day workshop, June 14-16, 1971 was organized for persbTtViel of 

rehabilitation facilities on topic of "Research Utilization in 
Rehabilitation Facilities." This was sponsored by ICD Profes- 
sional Education training funds. 

- Rehabilitation International sponsored 'a day in Research Utiliza- 

tion at ICD on June 15, 1971. 

- The RUL Information Specialist took part in the Institute of 

Rehabilitation Services, PA/VR Prime Study Group, California, 
December 1971. 

- RUL Supervisors took part in workshops at the IRS Conference in 

Minnesota; also set up an exhibit. May 1972. 

- RUL materials were distributed by the Supervisor at 12th World 
. Congress, Aust-r-a-Wa^-Auguat A97|. . 

- RUL collaborated with Psychologists from Goldwater Hospital in pre- 

senting a 2-day conference in June, )973 to meipbers of APA 

o . 37 
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Division 22 on -Research Utilization for the Disabled and Disadvan* 
taged. , 

RUL input on the mul tihandicapped went into the 1973 UCP International 
Coi^fer^nce on Models for Service and into 1974 Academy for Cere- 
brail Palsy Prevocational Instructional Course. 
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Program Evaluation: V\ New Emerging Priority 

^ Since proggarnning is\i State-Federal partnership. States must have effec- 

\ 

t.ive methods of furnisfiing the Federal agency, as well as their own appro- 
priating bodies, with evaluation information. Program evaluation had been 
emphasized as part of T^Je Expansion Gijant effort but few states understood 
the techniques or method^. Therefore, at the suggestion of its PA/VR Task 

^ Force, ICD-RUL joined this national effort in February, 1972 by hiring a 
Resource Analyst, proficient in evaluation methodology* She conducted 
literature searches; established a linkage of evaluation cgnsultants through- 
out the country; and made input at national conferences (IRS Workshops, 

'Minneapolis, 5/72; PA/VR Conferences at ICD, 7/72; APHA Models for Program 
Evaluation, 11/73). ^ 

At DRU request, the, Resource Analyst spent 3 months in Washington, DC with a 
task force assigned to build a conceptual framework' for an information manage- 
ment system for the Office of Program Planning & Evaluation. Upon return to 
ICD, the major activities of the Resource Analyst, fn conjunction with the 
Associate RUL Supervisor, was development of the first two program evaluation 
manuals for State agency use in the USA. (7) (8) 

The first manual ^"Program Evaluation - A Resource Handbook for Vocational 
Rehabilitation," was published in Feburary, 1974 in an edition .of 1 ,000 copies. 
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The publication of the manual followed closely the 1973 Amendments of the 
Rehabilitation Act. Thus, the manual represented the first material avail- 
able to the States thatj^apbnded to the evaluation provisions of the 
amendments. Th6 supply'of 1,000 copies was exhausted in less than six 
months. The RUL with the assistance of ICO, then had the manual reprinted 
in a more professional format and offered it for sale at cost late in 1974. 
Since that time, over 1,800 additional manuals have been sold. C 

The two manuals reflected a compilation of the approaches, methods, tech- 
niques, and measures for program evaluation organized through the develop- 
ipent of a unifying conceptual framework. A detailed examination of over 
300 publications on program evaluation clearly indicated that there was 
little agreement between authors on concepts or even definitions of terms. 
Consequently, the structuring of the conceptual framework became a critical 
aspect of rthis work^. In addition. States were also surveyed concerning their 
evaluation programs underway or planned. This questionnaire brought a wealth 
of applied information into RUL Information Center in the form of hand- 
books, forms, planning doci^nents etc., as well as detailed State evaluation 
plans and programs. These documents served as the bridge between PA/VR and 
the new direction the Information Center was to take in the second five years- 
Program Evaluation in Vocational Rehabilitation, PE/VR. / . , 
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THE SECOND FIVE YEARS 
. (June 1975 to May 31 ,1980) . ^ : 

In 1975, the RSA Research and Demonstration Strategy placed major emphasis ' 
on the. "Improved Administration of Management Practices. '\( 9).. Tljfs "dlrect- 
ed the overalT.RUL grant ^oa^ to KNOWLEDGE UTILIZATION f OR IMPROVED MANAGE^ 
MENT, PRACTICES. It also broadened the RUL focus of attention from disabled 
clients who were on. publi.c assistance to all vocationally vulnerable popula- 
tions ( 1.9/5-1 98a) . ^ (See- Ftgure^rir) . " ^ . ^ • , ^ 

In addressing these concerns, the -ICD Research Utilization Lab had thr.ee ; 
actions tfirusts: " - . ' ' ' • ' 

- to initiate field studies i^/herein R&D project results w^re to be 

translated into Practical Service Delivery Models useful in pro- 
grams for vocationally-vulnerable clients served. by State VR 
agencies and their support facilities . ^ , 

- io inve$tigate the effectiveness of establi^shing an Information Cen- 
^ ^ " ter wb,ich would specialise in' the .dissemination pf Program ^ 

' Evaluation' materials to Federa'l and S.tate Agency .staff and their 
suppDS^t' per^nnel ^ ' 

- 'to resDond tC), National Needs Withirf the'jjroficiency of the RUL staff 

' 1 . innovative Service Delivery Models , v - ^ . ^ ' 

^ This process required the following sequence of activities: 

• — * Selection of Mociel after review of RSA. priorities,, of target 
group naeds and/af potential resources. 
Design Model and set up a format of activity guidelines. 
-Development by RUL or subbontractors' 'review. 
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COMMUNITY RESOURCES FOPT MENTALLY ILL: A MULTI-FACET MODEL 

, (PROCESS MODEL) 



The multiple needs of the "post-hosplta lized mental patient were acureiy 

Y 

revealed by the national thrust toward de-institutional ization. By 
early 1975, only 130,000 or the original 430,000 (196$) mental patients 
remained in the natipn^'s hospitals and few precedants existed for com- 
munity-based services. In response to this situation, ICD-RUL developed 
a model for the coordination of those services needed to integrate and 
maintain mentally recovered ))ersons in the community. The concept of 



covered )^ers 
throu^ tfrhe 



encouraging clients throu^ three progressive steps of independence for 
their Living Arrangement, Socialization, and Preparation for Work pro- 
duced 3 9-element. model . We then contacted 81 resources around the 
country and cited their unique procedures within the most pertinent ele- 
ment of the^nine categories. Jhis jDroduced a Handbook from^hich various 

.J 

combination 6f these nine elements could be used to individualize programs 
for members of the target -population. In January 1978, the first 500 
copies were disseminated to^the White House, to Federal and State Voca- 
tional Rehabilitation and Mental Health personnel, as well as to all con- 
tributors of incorporated materiajs^. By June 1978, we had only 50 copies 
of the ori,ginal 1 ,000 printed and a second edition»was planned. We up- 
dated the resources and, obtained some valuable additions^ Judith Turner 
of NIMH, contributed a section on Community Support Programs, Iris Gel- 
berg of NIMH, abstracted th^ RSA-NIMH Cooperative ^Agreement, while 
specialists from Georgia, North Carolina, Texas and West Virginia sent in 

■ .42 - ' 
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examples of State Agency agreements. We added a Topical Index, NIMH 
matched RSA funds aj?d another 1,500 copies were printed. Copies- of 
thfS second edition also were quickly-exhausted. _ In the Fall of 1979, 
NIMH provided additional funding for the priViting and distribution of 
another 1,500 copies of a Third Edition. * At present, less than 300 
copies of the third edition^yemain. 
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b. PLACEMENT PREPARATION PROGRAM (Product Model) ^ 
Using audio-tape cassettes as a stimulus to group discussions and a 
comprehensive manual for the group leader, RUl^ in conjunction with the 
ICD Rehabilitation Services Department designed the Placement Prepara- 
tion Program (PPP) to deal. with attitudes and responsibilities required 
in the workplace. Through structured activity the program helps prepare 
the disabled and disadvantaged earl'y in the rehabilitation process for a 
* successful placement outcome. , ^ 

. 

The tapes portray rda\ situations which capture the interest of clients 
and directly involve them in critical self-a^r^fsal and proWem-solving 

• • - ^ " ' * 

Why People Work — Why People Don't Work 
Worker Responsibilities: Good Work Habits 
Worker Responsibilities: Productivity 
Getting Along 9n the Job: Co-Worker Relations 
Getting Along on the Job: Supervisor-Employee Relations 
Fears Related to Going to Work 
How to Get There:- Personal Qualifications 
How Do You Get There: Application 'Forms 
How Do You Get There: Job Hunting Techniques^ 

,9^ * . d 
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In this way, clients explore their own feelings regarding the work 
world, recognize th^ir fears and anxieties, and are helped to realized 
the importance of their own skills and abilities. Having done so, they 
have sharpened their sense of self-understanding and self«-esteeni enabl- 
ing them to seek and successfully hold a job. 



ICD tested the PPP on a number of groups involved in our prevocational 
workshop and vocational training programs, incorporating it into our 
on-going program in 1975. In September 1977, RUL receivjra an RSA Short- 
Term Training Grant #44-P-81251 to train State VR Personnel in these 
early placement preparation techniques. Since then /a pilot series has 
been used successfully by agencies across the country with excellent re- 
ports received by our Research Utilization Laboratory. In response to 
demand, ICD. has published -the manual and reproduced 'the -tapes for sale" 
so that other institutions and vocational training groups can take advan- 
tage of this approach. To date,' over 175 copies of the program have 
been sold. 

% 

FOLLOW-UP STUDIES AND- ABSTRACTS (Process Model) . 
In January 1976, ICD-RUL distributed a questionnaire to State VR agency 
personnel as a "need, sensing" tool to elicit any problems experienced in 
activities related to Standards for Program Evaluation where no data 
elements could be extracted from regular reporting system. Returns in- 
dicated that were ICD-RUL to develop a process-type model in the area of 
Follow-up, as it did three years ago for PA/VR guidelines, this would 
respond to a very real VR agency -need ifi assessing- the service to prior- 
ity populations and in providing information on which to improve service 
delivery. Format and contents were outlined and development of the 



monograph was subcontracted to Dr. Kenneth Reagles of Syracuse Uni- 
versity. In November l'978, the manuscript was reviewed by the Program 
Evaluation Task Force of Region II and in response to their comprehen- 
s'ive critique, the manuscript was returned for final revision in 
December. The~ final monograph was" probably the most complete compila- 
tinn nf iiser-oriented information in the area of follow-up stu dies. . 
It specifically addresses the concrete needs of program evaluation 
'personnel charged with designing 'and implementing follow-up studies. 



Starting with the purposes of and needs for follow-up studies, the book 
details planning, types of surveys, instrument construction, pre-testing 
^d data collection strategies. Considerable material is included on 
personal and telephone intervi'ewing. It concludes with a section on 
data collection, storage, analysis and utilization. Each area of concern^ 
is given an in-depth treatment and is liberally illustrated wijh examples 
of foms, questionnaires, and follow-up letters, together with useful 
tables and charts determining sample size and appropriate statistical 
treatments. 
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While many of the illustrations are drawn'from the field of Vocational 
Rehabilitation, the material contained in the book is basic. Thus, the 
techn'flfiJifs and procedures discussed can be easily applied to the imple- 
mentation of follow-up studies in many other of the h}nan services such | 
as social services, mental health, and medical services. ^ book can 
serve as a handbook for reference to program evaluation personne/l ; as a 
training tool for any human service worker involved in follow-up studies; 
■ or as a textbook or supplementary reading for courses in program evalua- 
tion or counselor education. 
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Concurrently, we subcontracted with Dr. LeRoy SDdniol of Boston 

f 

University for "Follow-up Studies: Selected Abstracts." 

This" volume was a critical presentation of both completed follow-up 
studies and papers of methodological interest. Dr. Spaniol described 
sampling, case finding, data collection and utilization of results and 
then coimients on the strengths andweaknesses of each study. This 
^proved to be a fine companion piece to Dr, Reagles' handbook. 

WORK-RELATED NEEDS (Product Model) 

y 

This model was based upon the relationship of the hierarchy of needs of 
a disabled -person to his option for work. During 1979, a script was 
written to alert counselors and rehab 'counseling students to the 8-need 
areas requiring attention if a client is to fit into the working world. 
Some 17 visuals were designed by ICD-RUL and sub-contracted to artists. 
About 135 photographs were taken to illustrate the script, and a booklet 
introducing the 20-minute audiovisual program to its users was written. 
The program was not designed to provide solutions. It was meant to 
trigger group discussion and exchange, and to encourage rehabilitation 
personnel to consider a range of potential employment barriers which may 
not have been sufficiently covered in previous training. At a time of 
rapid counselor turnover, many agencies experience a constant influx of 
new personnel. WORK RELATED NEEDS: AN INTRODUCTION attempted to help 
meet orientation and in-service training needs. Though the program was 
primarily intended for new counselors or counselors in training, it was 
of interest to aidfes and paraprqfessionals 3s well. " 

Drafts -of the script and l?ooklet were submitted to three St,ate VR 
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counselors in charge of training and their suggestions were incorporated 
into final di*Sk£t«^ The program was auccessfiilly piloted by the ICD 
Vocational Rehabilitation Department, where it is still in use. The 
final slide-synch audio product was distributed to training personnel in 
each State VR agency and to Rehabilitation Continujng Education Programs. 
Its availability was made known to University-based counselor training 
programs, and preview copies were placed on file at the Materials Develop- 
ment Center. University of Wisconsin-Stout of Menomonie, Wisconsin. 



CREATIVE COMMUNITY OPTIONS (Process Model) 

While classical emphasis in rehabilitation has been on work adjustment, 
it is- important to note that success in the working w^J|ld can seldom be , 
attained without prior appropriate social and personal adjustments. 
Even the non-vocational goals of independent living must include a repe- 
toire of responses for productive self-development and participation in 
society. 

Therefore, to assist rehabilitation personnel, or self-help groups, in 
their counseling efforts,. ICD-RUL has culled examples of community re- 
sources from all over the USA which illustrate social adjustment experien 
ces that dre-now available to disabled populations. From a practical 
point of view, this RUL handbook has grouped these service resources 
under six major categories: 

- Socialization (Use of Leisure) 
Sexuality (Responsiveness & Responsibility) 

- Personal Growth ^Hobbies & Education) ' 

- Comnunity Service (Consumer Advocacy & Volunteering) 
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* ■ - Recreation (Sports and Activities) 
Transportation (Transport i Travel) 

These resources listed in no way imply what should be done; they ia- 
dicate what is done now. As such> they provide cues to people in the 
field who are just approaching these problems of social adjustment, 
and they suggest needed research and programning by the very gaps that 
are revealed. 

The full title of this handbook became "Conmunity Resources for the 
Social Adjustment of Severely Disabled Persons: Options for Involve- 
ment". Work was started on it in 1979 and in October^ 980.- some 600 
copies of the 1,000 printe^d were distributed to Central Offices, 
Regional Offices, and to State Vocational Rehabilitation Directors and 
counselors on the ICD-RUL mailing list. In addition, several copies 
were placed for loan with MDC, NARIC, and the Independent Living- Research 
Utilization Project in Houston, Texas. 

» 

PE/VR National Information Center 

The establishment of a National 'Program Evaluation Clearinghouse^in 1975 
related directly to the Management Practices sub-issue of the General 
Research Objectives wherein a major research goal (item F) is to "Develop 
Improved management information systems—". (See Figure IV) 
CLEARINGHOUSE OBJECTIVES 

(1) To acquire' and disseminate info.rmation (publications and documents) 
related to program evaluation as it applies to State VR agencies in 
support of the federal mandate as stated in PL93-112 Section 401. 

(2) To make available to all' State agency personnel the results of 
Program Evaluation techniques and operations employed by Progr?m^ 



FIGURE ,IV 
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Evaluation personnel in State agencies who have pioneered in these 
directions. 

(3) To retain those linkages relevant to Program Evaluation which 
were established during the 5-year period when the core area of 
the Info-Center was PA/VR; to reach out for new linkages which 
will enhance Program evaluation efforts. 

> 

These RUL objectives relate to the Management Practices sub-issue of 
Information Availability in support of the Management Processes of 
Communication and Program Evaluation.. Since much of the information 
disseminated has originated from relevant research and practice, the 
Information Center )^lates to that function of the Research Utilization 
sub-issue wherein, thfe mass of information is to be sifteci so as not to. 
"overwhelm a busy practitioner or manager." 

(4) To utilize the/lCD-RUL "know-how" for development of material 
having immediate usefulness to State VR agencies but not obtain- 
able elsewhere. 

This objectiv#responds to the sub-issue on Communi- 
cation wherein it is recognized that the real prob- 
lem in coninuni eating within a management system is 
"how to manage, package, reduce and summarize the 
information already available." 

* 

(5) To make available to the Committee on Research and Evaluation of 
RSA and the council of ^tate Agencies (CSA-VR), and to designate 
state agency personnel with PE responsibility, knowledge on pro- . 
gram evaluation obtainable from other data files such as industry 
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commerce, education (DIALOG Computer Retrieval). 



This objective relates to the Management Practices 



sub-issues of Information Availability in support 

of Cormuni cation as a Management Process. While 

the VR system is stated to have, a more effective 

information system than any of the other SRS 

State programs, it is conceded that "There is 

much room in enlarging, expanding and summarizing 

information flow. " i ' 

These objectives were translated into the following actfon components: 

Document Review - Document review prior to inclusion in the information 
center collection was .an ongoing activity of the RUL Supervisors through 
out the 5 years. Questionable documents were reviewed for applicability 
of inclusion and other highly technical documents were reviewed for 
appropriate indexing terms. All State evaluation reports, from FY 1975 
dn that were submitted to RSA, were reviewed by the RUL Supervisors and 
were entered into the system. In this manner, both supervisors became 
faqiliar with the holdings and could thus directly respond to questions 
concerning these holdings. This familiarity has enabled tKe. RUL to 
quickly fill specialized requests for information. For example, when an 
emergency call from a State Agency asking for cost benefit information 
that was needed that same afternoon for a oresentation to the State Legi 
lature, the Information Center supervisor washable to respond to the 



request over the phone partially because of his familiarity with the 
holdings. \ 
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New Retrieval System - In anticipation of the information needs of 
State Agency personnel, the Associate Supervisor examined several 
data retrieval systems and consulted with users of the same to assess^ 
practicality. With the view of- minimizing turn-around time in re- 
trieval and of insuring comprehensiveness of searches, the Temiatrex 
Syst^ was selected. A highly important feature of this/ system is 
that it is convertible to IBM card format, thus lending itself to 
conversion to computer retrieval, should the latter become-desir- 
able at a later date. The Termatrex System has operated smoothly 
during grant years. The operation^ of the system in coordinate search 
has been excellent, yielding comprehensive and rapid results. The 
Termatrex System allowed the filling of special search and bibliographic 
orders. to be accomplished in a minimum of turn-around time. It is 
to^be highly recommended for a specialized small collection such as ours. 
Several Federal contractors and Federal Agencies have examined the sys- 
tem with great interest and have expressed a desire to include such a 
system within their own operations.' 



Catalogue Problem'; and Resolutions - Since no national thesaurus on 
Program Evaluation exi,sted, RUL gave input -to the efforts of the UWrRRRI 
and attended the Julyl975 conference held in Madison, Wisconsin for 
the purpose of developing the- basic structure of a PE Classification 
System. This Classification System was subsequently distributed by UW-RRRI 
Using an early draft on this document as a departure point, RUL 
Supervisors and the Information Technician developed a Subject Heading List 
^for Temiatrex input and retrieval of ou/ PE holdings. 

PE Acquisition and Cataloguing - Informal contacts to acquire PE input 
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-were given needed impetu? whert^ Commissioner Adams* Infofoiation Memo- ^ 

' ^ . \ - ' '^'^ ' ^^'^ ^ ' ^ ' 

-ran4um was ^'ssued' on February 6/ 1976, informing Sitate and Regional 

VR off ides tbat "ICD-RUL se|;tijfig up a s6mi-automated retrieval sys> 
'tem and jjs now ready for i'nput^from States;" Rei^pons^es were^gVafifying^ 
from States tn the form o^jexpressed cooperation and materia.B.^ As af ' 
mid-March, over 700 documents received acqu4"sition numbers were coded 
for bibViographic information apd assigned'^d^scriptors. By the en^l of 
the second year, the col-lection contained assigned numbers for almdst 
1,400 documents. An addition Of approxfmately 300 document numbers' each 
subsequent year, brought the total number of I'tems iti the 5-year collec^- 
tidn to approximately 2,000. To access |iiJblish6ci literature, over , 
twenty periodicals were reviewed on d monthly basis'. These incliuded 
catalogs af Federal arid Stat^ documents; also NTIS holdings 'in ar,eas re- 
lated to PE and special iz^ed, PE periodicals, ^ ' ' '-y , ^ 
-> 

PE Hailing List - Throughout the 5 years, the PE mailing list was updated 
daily 'as requests for changes and additions come in. CTue to staff turn- - ' 
over and relocation, a great deal of effort was expended in the conti'^fijjed 
revision of the mailing list. In addition, names were adde^^frpm a ^ 
variety of lists that we acquire from time to time., 'Yearly, the mail itig 
list contained close to 1,300 entries. However, our returns intJicate 
that our readership was much greater than this figure, since many requests 
came from individuals who -were not on the mailing list. The largest 
single increase in mailing list entries came about through the appear- 
ance of a non-solicited notice of the Information Center activities which 
appeared in a September issue of the NRA Newsletter. This notice yielded 
over 50 requests from national organizations, international organizations, 
(United Nations) and private facilities. WPiile not within our primary 
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target population, requests frbhi such groups are honored on a non- 
priority basis, as time and resources allow. 

\ 

PE/VR Resource? - The Program Evaluation Conmittees of^both the Council 
of State Agencies and the Regions (I-X) plus the RU linkages working 
with RSA Evaluation and Monitoring Branch, provided a 2-way information^ 
system during the development of our Information Center.' Furthermore, 
State Agency program planning and management personnel were invited to 
collaborate with ICD-RUL in selection of topics having implications for' 
present progranming but neediiig greater exposure and clarification. 

PE/VR NEWSLEHER •. - 

The first issue of the PA/VR Newsletter was circulated in February 1976 
to State VR Directory, State VR personnel assigned to Program Evaluation 
responsibflities, as well^^fi^deral staff in the 10 HEW regions and 

'central office, Washington DC. Each 12-page PE/VR Jewsletter (issued, 4,. 
times per year) contained abstracts of new program evaluation iioldings, 
a Feature Page 'devoted to a particularly timely or innovative PE proce- 

/dure written by field personnel, ,and an Order Foi^ on the last page. 
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Forecasting the content of each Newsletter was partially accomplished 
by inserting two or ^ three topical "test" items in each Newsletter 
issue to- assess the potential demand of any topic. Those areas that 
demonstrated heavy demand were then developed into a topical issue of 
the Jtews letter tn which at least 50% of the items were devoted to a 
specific topical area. This technique was developed when it became 
apparent that those who responded to requests for topical suggestions 
were not representative of the readership as a whole. The use of test 
probes seemed to work quite well in determining what are the interests 
of the readers. 



PE/VR AND RELATED DOCUMENTS 

Among the materials developed in the area of program evaluation for use 

of training conferences or in response to the know4-edge needs of reha- 

bilitation personnel in State and private agencies were the following 
publications of the ICD-RUL staff: " J 



Bennett, C, and Weisinger, M: Program Evaluation: A Resource 
Handbook for Vocational Rehabilitation. New Yprk: ICD-RUL. 
: 1974, 150 pp^ . " 



^ Wei singer"*, M>, Rob.inault, I. and Bennett, C, (Eds.), Program 

Evaluation: Selected .Readings, New York: ICD-RUL, 1975, 90 pp. 

\ 

Robinault,. I. and lleisinqer, M. (Eds.')> Program Planning h Evalua- 
tion: Selected Topics-' for Vocational Rehabilitation, New York, 
, ICP, 1975, 114 pp. • 

ICO-RUL, Images, VEWAA Bulletin/ March 1976, 9:1 
Robinault, I, and Weisinger,.'M. , A brief history of the ICD Research 
Utilization Laboratory'. Rehabil itation "Counsel ing Bulletin, 1975, 
^ .19, 4'26-432.".. 



Bennett, E. C, and Weisinger, m' .'Program assessment. Chapter in 
Gilbert, N.- and Specht, H. Planning f-or Social Welfare:. Issues, 
- Model's i and Tasks.. Englewood. Cliffs, IJIJ: Prentice Hall , 1977, 
pp. 3'§>379 ' .% ' 



Responses to National Needs (1975-1980) 

Over the years ICD-RUL developed a reputation for rapid turn-around 
time in response to queries within the staff's proficiency and a 
competent use of national resources through the person-to-person 
information network developed informally among research utilization 
units around the country. Activities in this area included: 

- PLANNING: RSA and UW-RRRI (1977) 
Two major assignments, namely partit:ipation in the UW-RRRI 
conference on PE Classification system and the RSA Participa- 
tory Planning Conference in Atlanta were paid for out of host 
budgets, saving RUL estimated expenditure in our budget for 
nation^al seminars. 

' - ILLUSTRATIONS of I & £ APPROACHES (RSA Priorities FY 1978) 
^ In FY 1978, I i E funds were to be allocated to the States on 
the basis of the degree of innovative activities proposed. Too 
often in the past, these funds had been used by the State Agen- 
cies to support ongoing activities. In order to aid the States 
in the preparation of their I & E applications, it was proposed 
that the RUL prepared digest and updates of several successful 
I & E projects that had been previously funded. 

A commfttee at Central Office Identified potential projects by 
August 22nd and by October 1977, ICD-RUL wrote the summaries and 
delivered 500 office copies to the RSA Office of Program Develop- 
ment. §ome field trips were made to verify Input, but because of 
Qur people- to-?people linkages, much reliable information concern- 
ing field a^tivities^was received from: dames Fine (ND), 



Ed Tully (MAl^ Adrian Marinelli (NJ), Carol Whitcraft (TX), 
Roy Cronenberg (TXl. Mary Goodwie (MA), Kenneth Hornnicut (TX), ^ 
and Ray Dabney (TX). OPD distributed these digests to each 
State agency. 

NTIS MICROFICHE (1978) 

This grant year, the NTIS microfiche, whi^rh were added ^to the RSA 
Research Information System, were.sorted and distributed by RUL. 
The shipments from tlTIS had many inconsistencies which were 
detected by RUL and reported to RSA. 

LINKAGES AND COLLABORATION 

During the 8th grant year (1977-78), RUL contributed input to the 
RSA Participatory Planning Conferences on Research and Evaluation 
(Jan. 10-12, May 16-18 and May 19-21) to the RSA Peer Review of 
R & T Centers (Jan. 12-15 and Feb. 13-14), to' the l/niversity of 
Michigan's RRI Advisory Committee (Sept, 11-12 and April 23-25) 
and to the Quality Assurance workshops for Regions I, II and III 
(Jan. 31-Feb. 3). In addition, a special revieAf State Evaluation 
Reports was prepared at Dr. Garrett's reque 




NARIC AND NETWORK (1978-79) 
One of the highlights of this year has been contact with the 
National Rehabilitation 'Information Center under the able 
direction of Judith Senkov.itch. We have been able to refer to NARIC, 
questions from' the field that were misdirected to us and look 
orward to a formal network developing out of the congenial begin- 
nings of this informal contact. Toward that end, we are pleased 
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to serve on the Steering Committee for the new network. This 
coordinated well with our recent appointment to participate in 
Peer Review of Foreign Monographs for the World Rehabilitation 
Fund's Information Exchange, under RSA grant. 

RSA ASSIGNMENT (1980) ^ ^ . 

^n response to the Conmissioner's invitation, RUL served on the 
Review tonmittee for unsolicited research applications for grants. 

y 

MODEL EVALUATION UNITS (MEU) (1979-80) 

During ,the summer of 1978, RSA announced that it would provide a 
number of States with funds to' develop model program evaluation 
units (called Model Evaluation Units or MEUs). By early 1979, 
, six such units had been funded, yet the projects were little, known 
by the larger VR community. Since one of the objectives of the pro- 
jects was to keep State agencies infomed on the nature and accom- 
plishments of the MEUs, the* RUL devoted a special issue of the 
PE/VR Newsletter to the MEUs (Vol. 3 No. 3, Summer, 1979). Antici- 
pating such further activities, the RUL applied for and r6ceived a 
supplement to the grant. This supplement allowed the RUL to coor- 
dinate, edit, print, and distribute four issues of the MEU Techni- 
cal Assistance Reports (MEU-TARs), 

The RUL Associate Supervisor, who is in charge of the Program Evalua- 
tion Information Center, joined the MEU Advisory Committee and was 
involved in the^ preparation of a new format for projected publica- 
tion. Since that issue^ three additional issues of the MEU-TARs have 
been published and distributed. Mutual feedback indicates the publi- 



ERIC 



^ cation has been exceptionally well received^^ - 
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NIHR ASSIGNMENT (1980-81) 

In January 1980. the National Institute of Handicapped Research 
awarded ICD a supplemental grant (22-P-55060/2-10) to develop 
"Issues and Reconinendations for Knowledge Dissemination and 
Utilization" which would be relevant to the NIHR longTrange 
Research Priorities Plan, as mandated by PL95-602. The Assistant 
Director of ICD, David S. Reynolds, PhD, was designated Project 
Director for this activity and R. A. Vachon was its Project 
Manager. RUL prepared several working papers of factual*, 
historical and conceptual nature, focusing on the development 
and implementation of a reha/Tlitation diffusion model. A Final 
Report was issued by ICD to NIHR in'May 1980. Subsequently, 
ICD received a one-year extension grant (June 1980 through 
May 1981) to test the feasibility of certain aspects of this 
plan. Relevant activities will be recorded at the conclusion 
of the grant year iii^an Addendum, to this December RUL FinaV 

3 * ^ 

Report of the 10-year Research Utilization Laboratory. 
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II. ' ASSESSMENT ACTIVITIES: INPUT AND FEEDBACK ' , 

By their nature, RUL procedures are heavily assessment-oriented. Over the 
past ten years, we have performed in excess of 40 separate assessments in 
order to determine: 1 ) needs of target or user groups for the development 
of new materials, 2) the nature of current field practices with emphasis 
on any perceived deficiencies, 3) the efficacy of Laboratory^developed 
interim materials for the purpose of including field-generated modifica- 
tions in the final product, 4) efficacy or impact of final versions of 
Laboratory developed products, 5) target' population saturation of dissemina- 
tion activities, 6) efficacy and acceptance of dissemination activities*, 
7) the spread of effect of training activities, and 8) the general accept- 
ance of RUL products, training, and services. 

These assessments and evaluations were accomplished through the use of a 
broad assortment of information gathering strategies. The techniques 
employed ranged from highly structured format surveys through less formal 
(but no less structured) analyses of requests and growth of distribution t^^ 
very informal examinations of non-solicited letters frdm field personnel. 
In addition, assessments of need provided by Federal entities were incor- 
porated into the development and modification of RUL projects. Further, 
some informal evaluations were based on examinations of published non-solic- 
ited critical reviews of various RUL products. These revidUs served to aid 
us to determine the usefulness of the products as viewed by professionals 
outside of the RU and VR systems. For example, favorable critical reviews 
of on'e RUL product (Program Evaluation: A Resource Handbook) were published 
in both the American Journal of Occupational Therapy and in the Grantsman- 
ship News . Favorable reviews of other RUL products appeared in 



ERIC 



Rehabilitation Literature , NRA Newsletter , White House Conference on 
Employment of the Handicapped Newsletter and the lARF Newsletter . 

Some other indications of acceptance of RUL products and services con- 
sisted of indirect observations such as non-solicited descriptions (not 
reviews) of products or services which appeared in local Statewide or 
Regional publications: the selection of RUL publication to be reprinted or 
extensively quoted in^other published works; the selection of RUL pub- 
lications as text-books for use in University courses; and the selection 
of RUL generated materials as recommended reading in the Federal VR ' 
Manual. 

Assessmerits of RUL activities have been made on a task by task basis.* That 
is, w^/1?ave developed and performed a number of need sensing and evaluative 
procedures, each responding to the specific- requirements of particular sub- 
projects of the RUL. Where the results of formal assessments were obtained 
as part of separately funded training or workshop activities, those results 
have been published in detail elsewhere. In the remainder of this 
section, we will present several examples of sub-project assessments, each 
illustrating either a somewhat different method of approaching the 
problem or illustrating the manner in which the results of several methods 
tended to support each other. 

In the instances where feedback (evaluative) questionnaires had been dis- 
tributed with RUL developed materials to a large target user population, 
response rates ranged from 5-25%. When questionnaires were made part of a 
concerted training effort, response rates as high as 65% were achieved. In 
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one case where a need sensing instrument was tightl^e targeted and concerned 
an arfea of great concern to the VR comnunity. a response rate of over 80% 
was realized without the need foj^vigorous follow-up. While no claim is 
made that the results of queUionnaire returns were either totally repres- 
■entative or unbiased, the resets were usually supported by other independent 
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The First General Survey * 

Although the first information gathering survey undertaken by the RUL took 
place late in 1970 and was reported early in 1971, this was to gain infor- 
mation for a highly specialized project (the SRS-RIS). The first general 
survey concerned several aspects of RUL operations and was distributed in 
Apri>, 1973 with the publtcation of "PA/VR Policies and Practices - Resources 
fo^ Trainingl" The survey included .questions which attempted to ascertain 
if members of the community were aware of our activities (previous publica- 
tion, PA/VR Newsletter, PA/VR Information Center), whether they used any of 
the materials or services, and if use of the materials or services had 
geherated-any new^deas or resulted -in any agency operations or policy changes 
The resell ts of this survey were as follows: 

- 51.5% of respondents indicated that the volume with 

which the questionnaire had been distributed presented 
them with new ideas on PA/VR 

- 39.4% of respondents were'aware of the previous PA/VR fSblication 

"PA/VR Expansion Grant Projects: Guide Materials" that 
was published in January 1972. 

- 69.2% of the respondents who were aware of the earlier 

publidation indicated that it presented new ideas to them 
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Responses to the questions regardiijj^the PA/VR News letter indicated; 

- 54.5^ of all respondents were aware of the PA/VR 

Newslejbter; — — - 

- 77.8% of respondents who were aware of the Newsletter 

received it regularly. 

- 47.0% of respondents who had ever read an 'issue of the 

Newsletter, ordered materials from it. 

- 75.0 of respondentTTgceiv4fig materials 

indicated that they, had gotten new ideas from 
them. 

- 12.5% of those who ordered materials reported that use 

.of the information resulted in a change in agency 
policy. ~ - 

Responses to questions regarding the Information Center yielded 
the following results: 

- 39.4% of all respondents vfere aware of the Information 

Center Services. 

- 76.9% of those who were aware of the services had 

used the Information' Center 

m 

- 80.0% of users indicated that th^yji^ gotten- new 

ideas from the materials received. 

- 50. oi of u?ers indicated that th? use of the 

materials resulted in a change in agency 
policy, practice' or procedures. 
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Although the results of this first survey generally appeared to be positive, 
' the responses to questipns concerning awareness of other products and 
services seemed somewhat low. Less than of respondents were aware of 
our previous publication or of our information services. Upon examination 
of the characteristics of the respondents, it became clear that 43% of them _ 
were from public assistance agencies -- a target group that was relatively 
new to our efforts. This not only explained the low awareness figure of 
some of our previous efforts but also made th,e 54.5% awareness figure of 
the Newsletter more impressive. Upon analyzing, Newsletter usage in 1972, 
the first full year of publication, we discovered that less than 3% of 
users were hous'ed in PA agencies. The results prompted us to increase our 
out-reach efforts to this group. By the end of 1974,. the results of user 
analysis indicated that 27% of Newsletter users were housed in PA/VR 
agencies -- an increase of 80%. * . ** 
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The Information Center Activities ■ A Direct Assessment 
The Collection and Circulation 

The fir-st RUL Information Center (PA/VR) was established at the end of 
1971 with the publication of the first PA/VR Newsletter occurring in December 
^ In January, 1972 the mailing list consisted of some 200 individuals, and 
. document collection contained somewhat less than 200 documents. At the 
close of the PA/VR Information Center in 1975 the mailing list had grown 
to over*1800 and the collection held over 4,200 documents - an SOO^o increase 
in the former and a 2,000% increase in the latter. When the second RUL 
Information Center (PE/VR) was established at the end of 1975, the new 
collection stood at 400 documents and tha mailing list at 200 individuals. 
.in May, 1*980 the Newsletter circulation was approximately 1500 and the 
collection contained some 2,700 documents - increases of 650 and 575% 
' respectively. The slower growth rates of the PE/VR Information Center 
can be attributed directly to the more specialized nature of the topical ' 
area (fev/er materials available in PE and fewer people involved in PE).' 
While growth of circu-lation and collection size were valuable in determining 
the size of the target groups we were reaching and the comprehensiveness 
of the collection, this information did not reve^how well dissemination 
was proceeding. 

A series of counts were made yearly beginning in 1972 and continued 
to the last full year of Information Center operation in 1979. For the 
calendar years 1972-1975 (PA/VR) these were as follows:, 
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1572 . mi ^ mi mi* 

Total Users 

(Unduplicated) 128 322 401 337 



Total Requests 



188 421, 497 " 451 



Total Circulation , ... , ,qc 

(# Documents) 780 1,184 1,444 ,1,395 



Requests/User 



1.47 1.31 1.21 1.34 



Documents/User 6.09 . 3.67 3.61 4.14 

Documents/Request 4.15 2.81 2.91 3.09 



Monthly Circulation 

(Average) \ 65 98 . 120 

*Based on nine months of operation projected to 12 months. 



Total Requests 



116 



For the calendar years ]9i^-A97B (PE/VR) the results were: ^ 

■1976 1977 1978 1979 

Total Users ' ' -.rr one 

(Unduplicated) 118 152 155 206 



136 190 2S5 246 



Total Circulation 4f .^^ 

{§ Documents) 543 897 , 755 1,164** 

Requests/User 1.15 1.25 1.65 1.19 

Documents/User 4.60 5.90 " 4.87 5.65 • 

Documents/Request 3.99 4.72 . 2.96 4.73 

Monthly Circulation * • 

(Average) 45 75 69 79 j 

♦♦Includes pending circulation that was completed in 1980. Pending" 

circulation is not included in average monthly circulation. 
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..F^rom these yearly, data, it^was dete»^in6d that for the last full year of 
opera£ion„ 22% of the subsqribers of the PA/VFf Newsletter requested materials 
from'the Information Center through order forms and 15% of the subscribers 
of the PE/VR Newsletter: did the- same. \ ' ^ 

Other readers,' however, were able to obtain materials listed in the Newsletter 
from local ^sources. Thus, "documented circulation figures are probable under- 
estimates of document usage. ' if /One'considers 'that many documents were re- 
j3roduced by requesters 'for in-house use, the num^t>er of . individuals who 
received information based on Newsletter entries becomes quite large in 
comparison.io the figures reported above. 

Readership? too, is not totally reflected in circulation statistics. Although 
the.figures that relate us^ige and subscribers reported above are good estimates 
based on available data,, .there was clear evidence that readership was larger 
than the size of the subscriber list. When received. Newsletters were often 
circulated among staff and it was not rar^ to get orders placed by individuals 
those nam^s.did not appear on the subscriber 1 ists. 

The figures for the^ category requests-user represent the mean number of order 
form requests each user'made. The minimum value is 1.00 and would represent 
one oVder peir^ user. Values greater than 1.00 indicate a relat-ve repeat 
orde/* rate in which a value of 2.00 would mean on the average, each user 
placed two orders in a given calendar year. Since the contents of individual 
, issues of the Newsletter generally contained material from different content 
"areas, l^a r;epeat rate as high as 2.00 would be unlikely. Figures between 1.00 
and 1.99 i^Aiuld tend to indicate that: a) appropriate content areas for the 
Newsletter were being selected since the readershtp placed orders from more 
than one Newsletter in a given year and b) the reader's experience with the 
Information Center had been positive enough to encourage multiple orders. 
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Figures which approach 1.00 might be due to unfamiliarity of the readership 
with the services (cold start) as in 1976 or the publication of several News- 
letter issues containing highly specific materials, as in 1979. The latter 
point is emphasized when we examine the documents/request figures for 1979. 
Although the requests/user ratio in 1979 is second lowest of the PE series, 
the document/request ratio is the highest. This is due to the publication of 
two Newsletters in 1979; one that had few items of interest to the general 
readership (special editioh on utilization of PE results) and the other which 
had few items at all (special edition on the MEUs). The items of the remain- 
ing two Newsletters were extremely popular, however. Not separated from the 
figures presented here were special search activities of the Information 
Center. During the period 1972-1979, close to 500 special searches of varying 
complexity were performed on request. All of the searches resulted in develop- 
ment of a specialized bibliography sent to the originator. In many cases, the 
requester obtai ned t he 1 isted documents locally. In these cases the results of 
the search are not reflected in the circulation figures. Although other aspects 
of "the circulation statistics were regularly examined to determine demand, work 
load, ^nd success of topic selection, the examples above present the main ideas 
of how we performed assessments of our general Information Center operations. 

. Needs.' Target Groups, and Usage 
Since the Newsletters contained oniy'8-12 pages, it was impossible to publish 
abstracts on all new items from our rapidly growing PA or PE/VR collections. 

Thus, items had to be selected for inclusion - but on what basis? Since our 

I 

approach in the Information Center was non-evaluative it would have been diffi- 
cult to include items solely on the basis Vf their "goodness". Therefore, we 
decided to include items* that responded to felt needs of the readership. 
Within the need areas some gross selections would be made on the basis 
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of rigor, comprehensiveness, topicality or inventivjeness contained in the 
item. Our first attempts to^etermine readers needs were to include several 
need sensing questions as part of the PA/VR Newsletter order form. The 
results obtained from this approach were disappointing at best._ Returns 
were few. Those that did return the need-sen^jng instrument did not agree 
'on which topics were of concern. Interests seemed parochial and highly 
specific. After several futile attempts to derive results from this approach, 
we decided to abondon it in favor of more indirect approaches. 
Two indirect techniques were used; forcasting and request analysis. Forecast- 
ing required careful monitoring of emergi^ng issues in PA/VR programming. Using 



Federal Information Memoranda, in-housejslate publications and, most important, 
personal interaction with field personnel at National meetings, it was possible 
to determine what were the most cruc\^l knowledge gaps. Materials that filled 
these gap5 were presented in the Newsletter as the awareness of the need for 
item grew among the readers. 

Request analysis was performed using request counts of materials. Since 
specific data on the number of times each document was requested routinely 
collected after the publication of each issue of the Newsletter, it was possible 
to relate request freq^ncy to the topical content of the document. In this 
manner, reader interest in specific content areas could be gauged. In addi- 
tion, once each year "PA/VR Literature" was published. .This document contained 
bibliographic entries, arranged by content, for several hundred<;pf the Center's 
holdings. Orders placed through the Literature added to the request analyses- 
Later, when the focus of the Information Center became program evaluation we 
once again attempted to elicit statements of need from the field - with the 
same disappointing* results as those we had obtained previously. Again, we 
begain to reJy on forecasting and returns' analysis. This time, however, 



ERIC 



64 



return ana^lyses were based on the inclusion of probe items in each edition . ^ 
of the PE/VR Newsletter. Newsletters were generally built around a topic or 
two. but in each issue several, items from different topical areas weije in- 
serted. The degree to which these test items were ordered allowed us to 
detemine whether a subsequent Newsletter should be devoted to specific items 
on the /"test" topic. This method worked quite well; it was not unusual to 
circulate over 400 documents from a topical issue where the topic was 
chosen in this manner. 
Target Groups. Usage, ahd Critiques 

During the PA/VR project several questionnaires were circulated to all 
subscribers in order to determine 1) the affiliation of the users, 2) the 
professional responsibilities of the users, and 3) the manner in which the ^ 
materials received were being put to use. During the PE/VR project, each user 
would receive a return card once in each year. These return cards included 
items on affiliation, responsibilities, and usage afid. in addition, allowed 
space for user consents. In generarthe results -of all the years of Information 
Center operation were strikingly similar. The results were: 

- The largest proportion of users came from State agencies. 
The number of users from private non-profit agencies "and 
i/niversities numbered two and three respectively. 
The largest proportion of users were middle managers responsible ^ 
for planning and implementation. During the PE/VR years, 
the proportion of users who were program evaluations .almost 
equalled the' number of managers. 
^ After the first yeaj- of operation of both the PA/VR and PE/VR, 
Information Center, approximately 75% of reported usage was in 
planning, implementation, or reporting of programs and projects. 
During the' first year most of the usage was for personal information. 
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- since most comments received were very positive, examination 
of negative comments was more telling. The bulk of "negative" 
comments were requests for expanded services (longer loan 
peri^ods,'' keeping received documents, faster turn-around for 
popular items, provision of copying services by the Information 
Center, more frequent or larger Newsletters, etc.). A very 
^^mall proportion of comments were requests for evaluative reviews. 
Three results of the user surveys thus demonstrated: 1) The organizational 
affiliation of our users were ranked exactly as our service mandate required: 
State Agencies an;| those who provided services to these agencies i.e., private 
facilities and universities; 2) The majority of users wer^at the service or 
project planning and implementation levels so that the materials distributed 
had the greatest potential for utilization; 3) The bulk of usage of the 
received documents was at the service or project planning and implementation 
levels, after ^users had some time (first year) to improve their personal 
knowledge; and 4) The major improvements in services requested by the users, 
if initiated, would have increased project costs significantly or would have ^ * 
changed the focus of the operations to that of an evaluative "expert" - 
an approach that could have been counter-productive in a project of 
national* scope such* as this. 

The PE Handbook - An Indirect Approach 
Need Determination * 

In January, 1974, the Federal Register contained the first regulations 
that required States to evaluate program effectiveness annually. Since 
the promulgation of the Rehabilitation Act of 1973, the RUL had been 
reviewing available materia^ls that mtght assist the State Agencies in 
performing evaluations. In addition, the RUL had already surveyed the PA 
Expansion Grant Projects attempting to determine the level of program 
evaluation expertise extant in the States. 



The results of the survey and review demonstrated that the^'levH of sophis- 
tication of State PE was low and few if any materials were available that 
could be quickly applied to State Agency needs. On the basis of this infor- 
mation, the RUL staff began work on a document in 1973 which would fill the 
apparent knowledge gap. Early in 1974, "Program Evaluation: A Resource 
Handbook for Vocational Rehabilitation" was published in an edition of 1000 
copies. ^ 

Acceptance and Impact 

Within a few months the entire supply of 1000 copies was exhausted. Antici- 
pating this' on the basis of the number of requests for the publication re- 
ceived, the RUL negotiated with ICO to provide funds for a reprint. The^ds 
were provided and the publication was recast with format and typographic changes. 
Late in 1974 the reprint was offered for sale at cost ($5.00). Since that 
time almost 2000 additional copies of the publication have been distributed. 
:'ln addition to 'orders for single copies received from State or private agencies, 
orders for multiple copies were received from university book stores. When we 
examined the source of the university orders, it was apparent that the book 
ms being used as a text Hn departments of Counselor Education. While we 
believed the demand for the book was an excellent estimate of acceptance, 
there were other indications to reinforce this belief. 

The publication received excellent reviews in journals such as j)i<habil itation 
Literature , Journal of the Occupationa l Therapy Association and most recently 
(1980) in Grantmanship News . In 1976 the book was included as suggested 
reading in the Federal VR Manual and in 1977, Chapter One of the\book was 
included in the book Planning for Social Welfare* as reading "Evaluation: 
Alternative Models - Program Assessment." 



*Specht, H. and Gilbert, N., Planning for S ocial Welfare: Issues, Models, and 
Tasks. Prentice Hall, Englewood Cliff, N.J., 1977. 
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Finally, we found that the book had beerv extensively quoted or reviewed in the 
publication of other Federally funded contractors or grantees §uch as JWK \ 
^ Associates and the University of Michigan RRI. 

The large distribution, favorable reviews and. usage to which the book had been 
put led us to believe that it had widespread acceptance and use, not just wide- 
s;pread distribution because it was "the only one*'. In this case, the forecast- 
ing of need based on an emerging priority seemed to be an excellent method. 

Community Resources for the Deinstitutionalization Mentally 111: A Direct- 
Ir|direct Approach 

Need Determination 

In 1976-1977 a new priority was beginning to emerge. Deinstitutionalization of 
the mentally ill became a NIMH interest. Cooperative discussions were being ^ 
held with RSA to assist in the rather small program that was about to be estab- 
lished. Again, the RUL staff surveyed the available resources but found very 
little in the professional literature. We determined, however, that there were 
a stibstantial number of programs around the country that were already address- 
ing this issue. We surveyed some 80 programs and in-1977 published "Mobiliza- 
tion of Community Resources A Multi-Facit Model for Rehabilitation of the Post- 
Hospitalized Mentally 111" in an edition of 1000 copies. 

Acceptance and Usage 

An edition of 1000 copies was out of supply in three months. Large numbers of 
multiple copy requests were received from State and VR agencies. Due to 
this considerable demand, a second edition df 1500 copies was produced with 
joint VR-NIMH funding. Supplies of this edition two were exhausted in less 
if than a year. A third edition of 1500 copies was then produced with the sole 
funding of NIMN and,' at present, less than 300 copies remain. The staff col- 
lege of NIMH used more than 250 copies in its national training activities. 
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Thus, in less than three years, almost 4000 96pies were distributed. A large 
number of multi|ble copy orders were clearly' from training groups. 
This publication, too, received a considerable number of favorable reviews fn 
.professional publications. The distribution history and the number of favor- 
able reviews would lead us to conclude that acceptance and usage was high (as 
in the previous example). In the case of this publication, however, a response 
form was included in the first 2500 copies distributed. Thus, the results of 
the response could serve as a check on the assumption that high distribution 
and positive reviews are indicative of high reader acceptance and usage. In 
addition, requests for copies had to be substantiated by need, and the letters 
of request served as a check for the potential use for the publication and 
the affiliation and job categories of the requesters. 
The results obtained from the responses were as follows: 

- 44.4% of respondents were in managerial positions. This is 

appropriate since most programs were in the planning or 
implementation stages. 

- 41.9% of rescpondents were housed in State agencies. As in the 

past State Agencies, Private Non-Profit Facilities and 
Universities ranked 1, 2, and 3 respectively. 
23.4% af respondents indicated that the publication was to be 

/'Ui^d in planning. Another 18.6% indicated it would be used 
in training. For some unknown reason 28/3% of respondents 
did not answer this question. 

- 93.7% of respondents replied that their reaction to the publi- 

cation was either Very Positive^ (53.1% of total) or Some- 
what Positive (40.17% of fotal) 




ERIC 



" 7^.6% of respondents replied that the potential or actual 
practical use the publication be put to within their 
organization was either A Great Deal (24.2% of total) 
or Quite a Bit (49.9% of total) 

s 

- 70.3% of respondents rated the Usefulness of the publication 
for Mental Health Professionals (or related fields) as 
Extremely Useful (25.9% of total) or Very Useful (44Jl% 
of total). 

Since the bulk of the responses to the. questions of overall impression, poten- 
tial or actual usefulness within the respondent organization and usefulness of 
the publication to other professionals, fell in the top two (positive) 
categories in each case, it seems justifiable to conclude that the distribution 
history and occurrence of positive reviews did indeed reflect ultimate user 
acceptance and usage. While ^is findirg cannot be generalized to the previous 
case, it adds some justification for thA assumptions made concerning acceptance^ 
and usage of the Program Evaluation Handbook . 

The^ Follow-Up Handbook - A Direct Approach 

Need Determination - - . ^ 

Early in 1976, program evaluation was a pressing issue in many State agencies. 
In "order to determine what, if any, knowledge gaps existed in program evalua- 
tion, we surveyed state .evaluators by asking a single open ended question, 
"What topic would you suggest for a monograph on. program evaluation"? 
Responses were few and the answers so diverse that they were not meaningfully 
categorizable. Since, at this time, the Federal PE Standards were being inten- 
sively discussed, we developed a second questionnaire based on issues revolving 
about the standards. This questionnaire consisted of a check list and was 

sent to the State VR Directors. 

r 
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Without the use of follow-up reminders, we obtained an unprecedented 
84% response rate. ^While other responses were scattered, over 50% 
of the respondents indicated they did not feel they had an adequate 
follow-up procedure in their agency. 

Since the RUL staff had no special expertise in this areaj^je decided to 
subcontract the preparation of a Jollow-up Monograph. The RUL 
prepared the specifications for the monograph and in May, 1976 the,, 
contract was signed. Due to 'numerpus delays a preliminary draft 
was not rvficeived for review until late 1978- ^nd the final version was 
published in 1979 as A Hand-book for -Follow-up Studies in the Human 
Services . An edition of 1000 copies was printed. When the books were 
distributed a feedback .form was included. Our concern about this product 
centered mainly up8n the large amount of elapsed \me between the need - 
-sensing and production of the material. Would user need dimiiiish'over 

/ ' 

the three years; would: the book be useful? ^ 

Acceptance and Usage ^ ^ ' , 

The responses on the feedback of orms were overwhelmingly positive. 

- 100% of respondents rated their overfall reaction 

to the publication as eithfer Very, Positive 
(72.2%) or Somewhat Positive (27.8%). 
,100% of respondents rated the dimensions of Format,^ 
- Organization, Relev^ance, Clarity and Usefulness 

• as either" A or B. Possible ratings were A, B, ; • 
C, 0? or F. - : * V 

- 88.9% of respondents rated the Potential Use Expected 

as either A ^reat Deal (27.8%) or Quite A Bit (61.'1%) 
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55.6% o-€i respondents had .already put tlie information in 

the publication to practical use. 
94.4% of respondents rated the Usefulness, of the publi- 
cation to Program Evaluation as either Extremely 
Useful (27.8%) or Very Usefu? (66.7%) 
When the affiliation of the respondents was categorized again, State Agency 
personnel accounted fof the bulk of the responses (72.2%). Rahkings for 
private non-profit agencies and universities changed,^ however, with universi- 
"ties ranked 2 and private agencies ranged 3. This is not surprising in view 
of the specialized nature of the publication. Distribution statistics are 
incomplete for this' product since its ^publication took place, late in 1979 
when the focus of the RUL was beginning to change. Therefore, distribution 
and dissemination activities were not as vigorous as they had been in the 
past. ' , ^ * ' ' J 

The Product Models 

During the ten years of operation the RUL produced three service related 
products, the Leader)ess tapes, the Placement Preparation Program (PPP), and 

Work Related Heeds. Evaluations of Acceptance and impact of the first two 

> 

products have been extensively reported elsewhere.* 




*The Leaderless Tapes Project was reported in Training Workshop in Implement- 
ing New Service Del i very. Techniques Final Report, Grant #45-81067, June, 

"I ^ 
1975. The Placement Preparation Program was reported in Training Workshop: 

Early Placement Preparation Program, Final Report, Grant #45-P-81251, 



September, 1978. 



The third proiiuct was completed and distributed in niidn980, at 
the clo$e of the Period covered by this Report. Jhy/^ t\o follow-up 
has bsen done. For the first two projects, we made extensive use of 
questionnaire, phon'e follow-up' and milestone markers. The degree of 
acceptance and impact are detailed in the respective reports. Since the 
publication of the PPP report, however, ICD published the PPP program for 
comnercial distribution. To date, an additional 200 copies have been sold 
at the break-even price of $135. 6o each, 

^The examples cited here provided a sampling of the various assessment ^ 
methods employed during the conduct of the RUL project. Some methods 
piay be subject to criticism of bias or non-representativeness. We 
cannot disagree with such criticism.. When a project is national in 
scope, the costs of obtaining representative unbiased samples quid<ly 
become prohibitive. Usjng distribution figure^tO document acceptance 
may be criticized because distribution depends, ir^fart^ on advertising 
and is thus a confounded variable.' Here t^, we must agree. J All methods ^ 
employed were the results of compromise between vigorous^^jta^Kdity and 
realistic estimates of funds, staff, and time available. 
A maj^r component of any utilization activity is assessment - assessment 
of need, assessment of- product or service usefulness, assessment 
pot^tial modificatjjm^ assessment of impact pf tl?e final Induct or 
servic\. ..Without tlW assessments, utilization efforts become intellectual 
exerfcis^, and utilizatiofi: projects operate in a vacuum. 
The ICp-HULprojeci-<Riessments were evblutionary— always changing 
to meet new demands. 'A review of the few' examples above clearly 

■ demonstrates that we neither engaged in intellectual ^exercises nor 
operated in an academij^vajcuum. . 



CONCLUSIONS AND RECOMMENDATIONS 

Based upon the ten years of RUL operations'; several conclusions seem 
evident. 

t 

Since most of the materials that were developed' over the course of the 
project contained a relatively large com^ptinent which consisted of 
successful pr*ogram practices, it would seem that the rubric "Research 
Utilization" may be too limiting. Rather, we would suggest adding the term 
Knowledge Utilization (KU) since that concept permits the developme^nt of 
models using' a host of sources that are not limited only to research (See 
Figure V) 

Since the RUL projects successfully covered a wide range of subject matter, 
it is clear that KU is a set of processes that is easily transferred to / 
many topical areas. The utilization processes seem ta be effective 
regardless of target group, subject matter or the nature of the developed 
materials. This is not to say that^ch problem area is approached or 
solved identically. Rather, the utilization processes contain an armamen- ' 
tarium of .techniques and methods that are not content specific. 'Thus, 
KU is another appropriate approach for many areas in rehabilitation 
where the implementation of previously develbped knowledge may result in 
• pro'blem soluticJn. \ 

One of the most important development activities in utilization projects 
is the establishment of a viable linkage* network among ^owledgeable indi- 
viduals. This becomes especially important if -uti lization projects are 
national in scope and diverse in. nature'. Problems in implementation 
occgr^ing"/ at a- sfte- distant from the utilization unit may be solved by a 
knowledgeable in^^ua] jeographical ly close tothe implementor. Or, the 
implementation p/oblem might be solved by an individucH l^wn to the^ 
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utilization unit who has already implemented the procedure or process. In 
addition, if the utilization projects are diverse, it is unlikely that 
utilization staff have all the answers. for each activity. Thus, linkage to 
content area experts becomes' critical . 

In most cases, information, techniques, and processes are sorely needed by 
field personnel when new Federal mandates and priorities are promulgated. 
Aqencies are then required to make chanqes in new directions, often on short 
notice and often without sufficient information on^ how to proceed. In these 
cases, a National utilization unit can quickly fill information and proce- 
dural gaps. However, this type of activity requires the utilization unit 
Xo be flexible, to be small enough to respond rapidly and to have advanced 
infonnation concerning impending priorities and mandates. If these require- 
ments are satisfied, the utilization unit can have significant National im-^ 
pact on the speed, ease and effectiveness of implementing new Federally 
required activities. 

If the support of such new agency activities as described immediately above 
jB requires a specialized data base, it is appropriate that the utilization 

unit assemble one and ac^i^^l^^issemi^^ the contents. In the early stages 
of new anency activities, per^sonnel often do not have sufficient infonnation 
to frame relevant questions. ► Access to a body of data and literature aids 
in the formulation of questions and later serves as a single comprehensive 
source of information. Few field personnel have the luxury of time to search 
many general sources and fewerj are aware of their existance. Active 
dissemination by a utilizatiol i nformati on. center , together wi'th a compre- 
hensive collection, accomplishes much to ai.d field personnel in the imple- 
mentation of Federal priorities and mandates. « 
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* In this ten year RUL project, face-to-face training has been shown to be 
a highly effective mechanism to insure implementation of both process 
and product models. Yet the RUL project had to apply and compete for 

RSA Short-Term Training Funds in order to accomplish its training objectives. 
Training priorities did not always match emerging RSA priorities. Although 
considerable effort was expended in developing these applications, in 
^ several cases the training proposals were not accepted. In future utilization 
projects, training should be an integral part of the project and training 
funds should be built in as part of the general project funding. 

Utilization activities are complex. Although reading the RU literature is 
of help in understanding some of the processes, no amount of reading 
adequately J^'epa res the utilization practitioner to deal with many of 
the field problems encountered. In addition, as noted above, the 
stablishmerft of a viable linkage system is a critical factor in the 

• ultimate success of many utilization programs. Finally, for a utilization 
unit to produce successful projects, the unit must have a significant 
degree of credibility among field personnel. To develop successful 
uVlization units requires sufficient time to train staff to solve day- 
to-diy operational problems, to establish viable, competent and trustworthy 
linkages, and to develop a "track record" that ensures the credibility 

of the unit. Therefore, utij-ization units should be funded on a long- 
term basis, wil^h .yearly required reviews. Unless these reviews reveal 
serious deficiencies, funding should be 'afvailable Ijor periods long enough 
to ensure the continuity of staff, credibility, and linka^s. Content 
. areas might change but the unit should remain as an intact entity in 
order to prevent, the wasting of resources that occurs when new units 
replace' older established units that have good records. of success. 



Some brief specific conclusions and recommendations include: 

- Perceived need of a. utilization product influences it accept- 
■ ability. If need is high, complex and difficult products are 

accepted. If need' is perceived as low,. easily implemented 

products are not accfepted. 

• - 

- Unless Process models are developed for a s'pecific agency, 
they must include alternative^.. Such models must be Jjroad 
enough or include enough alternati^Jfes so that many agencies 

"can implement useful portions of the' model . 

- Technical assistance must be made part of the, offer of any 
product or model. This offer may have to be subject to^ 
vigorous remi nderSg,^f it is to be accepted, however. 

- Developed products should be, as easy as possible to implement 
in the field. They should require no specialized staffing 
patterns and little administrative approval. These factors 
can be traded-off, -however, as can the facto^ of perceived 
need. 

- Where that is some doubt about the acceptance or feasibility 
' of a product or model, it should be thoroughly tested, 

^ preferrably at the site of the utilization unit. When 

Y_ possible. Unit staff must meet and solve- operational^ prob- 
lems, making them the knowledgeable consultants when field 
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PERSONNEL RESPONSIBILITIES 
RSA Project Grant #22-P-55-060 

Position . PROJECT DIRECTOR 

Time Spent on Project: 10% (No Federal Funding) 
Mame: * - James Folsom, M.D. 

Major function: administrative direction, details of which include: 

1. Liaison with DRU for RUL grant. 

2. Supplier of facilities ana bdsic materials. 

3. Hires grant Project Supervisor. 

4. Budget management. 

Position ' PROJECT SUPERVISOR 

Time Spent of Project: 100% , .,o/,nn\ ' 

Name: Isabel P. Robinault, Ph.D. (10/1/70-5/31/80) 

Major function: to plan and coordinate the de(/e1opment of all Research 
Utilization functions and supervise operations. Details of this include: 

1. Program planning responsive to ICD priorities and to Federal and State 
priorities; responsibility for time-frame and meeting deadlines. lo% 

2. Supervisor and Coordinator of staff' and project, in areas of media develop-^ 
ment, training and replication studies." ' ' 20% 

3. Inter and- Intra agency contacts, including RU linkage nationwide. •*10% 

4. Responsible for content-^nd format of monthly and annual reports. " _^ 10% 

5. Responsible for qra'nt progress reports and written products. 

6. Plans and coordinates utilization aspects within RUL grant and short- 
■ terra training grants (RIS, PA/VR & APA Div. #22). ■ ' 

7. Arrange Hason for replication studies, coordinated linkage with 
RSA, Selects, writes or edits requested materials for meetings. 

8. Consul tant-ICD Rrain-Injured Program and ICD planning and programming 
related to KUL proficiencies. 

Position ~ ^ ASSOCIATE PROJECT SUPERVISOR 

(TECHNICAL OPERATIONS) 

Time Spent on Project: 100": 

Name: , Marvin Weisinger, MA (9/15/71-5/31/80) 

Major function: to provide technical^ operation's , researchc^based expertise and 
supervision of the national Information Center. Other funcKons include main- 
taining f.leld contacts for determination of areas of need and liason with expert 
who provide support or services to the project. / , 

1 . Technical Functions are broadly based, emphasizing both specific techniques 
in attaining the project goals and general approaches or directions. 
Functional breakdown Include: ■ > 
a. Backqrourid Review for- Project Input ^ '0^ 

(1) Design of field questionnaires to ascertain felt need. 

(2) Critical review and analysis of existing research results. 10% 
^ b. Research Replication Design , 

(1) Development of replication tactics and approaches including 
the selection of appropriate analytic techniques, 
c. Data Collection for Information Center Utilization Project. 10% 
(1) Design of Feedback Forms, Ouestionnaires, and Reporting 
instruments to obtain input data. 




5% 



4 



(2) Format and operation of Videotape and Audio. recording 
project documentation (data collection) I 

d. Data Analysis ^ 

(1) Review' and*analysis of collected data (audio recording,, 
videotape, response tabulations, review of statistical 
analys^is). ^ ' 

e. Information Dissimination 

' ' (+) Preparation of dissemination vehicles (written documents, 
videotape productions, synchronized sound slide shows). ^. 

2. Sup.6rvisidn and nionltor_ing_.the national Information Center 
. . operations staff and budget involves approximately ^ 50% 
, \ * a. Consultation 4tr-teehnical areas 

b. Solution of operational problems. 

c. Editing Newsletter and Literature . 

d. Producing and editing of RUL Audio-Visual Training, aids 
for State personnel . 

e. Assists supervisor with input, content and format of RUL 
products. 

f. Serves' as Resource Analyst - in review of project methodology. 

D. Position: INFORMATION/^CHNICIAN 

Time Spent on Project: 1005$ ^ ^ ^ 

Name: Ann Finkler (9/7/71-3/22/72) Susan D. Ahrenhold, MA (4/10/7 ^12/75) 

^, Joann Must, MLS (12/l/7f37T[780) , 

^ ' Caverlee Cary, BA (8/1/78-5/31/80) 

Time is primariTy devoted to upgrading and impleme/iting the system 
whereby inforrnation retrieval is facilitated as much *as possible, and access to 
the system is made available to other staff members. B.asic ninctions include: 

1. Cataloguing functions: maintenance ^of a subject list! ^ 40% 
uniouely keyed to project goals and user needs, shelf li^t of all 
materials, original cataloguing of all documents received by author, 
title, and organization, as well as detailed subject cataloguing of 

all items. ' 

2. Assist Editor of Newsletter and Literature . '^/^ 

3. Aquisition-determilig publications to be purchased, requested, or 
Teroxed. This includes the reading of journa.l articles and book 
reviews, and the organization of bibliographies of all works received 
by the Center, in addition to the Government Printing Office, Monthly 
catalog, NTIS, Monthly check list of State documents. ^ 

4. Retrieval of Information-includes manual and computer literature 20% 
V 'searches and simple requests for documents, information about the- ^ 

Center, referrals to other sources of information, and bibliographic 
j'nformation. 

5. Supervisory Functions related to Bibliographic Assistant, Library 20{ 
Aids and Clerical Aids when available. ' 5%^ 
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E. Position: OFFICE MANAGER <^ ^ 

Time Spent on Project: 100% , ^ 

Name: Helen V. Carr (12/1/71-5/31/80) 

Organization and coordination of all office procedures which includes: 

1. {a) Conferences-arrangements-preparation of materials, travel, 

telephone and other. 

■ ' (b) Typing of rough copies and preparing typing set-up plus 15% 

the completion of all department manuals, or delegation 
thereof. • 

2. Newsletter 

(a) Typing rough copies and typing preparations, or delegation 10% 
thereof. " 

(b) Preparation of addressograph platesr. 5* 
- ' (1) Typing listing and preparing for mailings 

(2) Fine line type roller, correction of all titles and 
addresses, etc. | 

Mai Tinas - insert Newsletter and Literature and fliers where 5% 
necessary in 8 1/2 x 11 envelopes and putting envelopes in 
zip code order for bulk mailing, and coding of all plates. 



10% 



25% 



3. General Correspondence ^ 

Reviewing all letters and memos for the entire department • 
and assigned. 

Typing of bibliographies and preparations, or delegation 5% 
thereof. 

4. Mailing Dissemination ?• General Office Administration* 

(1) Handling (ff all department mailings-communications, 15% 
. . . NEWSLETTER : All' products not distributed through GPO . 

or HEW central offices. 

(2) Handling all mailings and scheduling of all tapes (HDI) 

5. Supervisoi^y Functions: 

Work of Clerk-Typist. ^ 
Office Temps hired under STT grants for special repor^ 
Client tr^ainees in Office Practice sent by Vocational 
ReTiabilitation Department. 

F. Position: / ^ CLERK-TYPIST . 

Time Spent on Project: lOO/ . .,^.,n^x 

Name: Linda Dale (10/15/70-8/22/73)/ Christiane Hick (10/5/73-5/31/80) 

This position enables RUL to meet the large volume of written materials 
necessary for communication and dissemination. It includes: 

1. Tyoinq fi^al drafts Itor duplication j 
(xeroxing, offset, and mimemograph) ^ ^ 

2. Types onejhalf of daily correspondence, including information 20% 
center requests. ^ * on<v 

.^^eneral office duties: phone messages, xeroxing,, collating. 20% 
Transcription of conference ahid project audiotapes. 20% 
Filing Information Center accessions and loan-returns. 20% 
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STAFF PUBLICATIONS 
RESEARCH UTILIZATION LABORATORY 
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''t" ^ APPENDIX B 



Grant Period June 1970 - May 1975 

^ '. 

Ahrenhold, S. and Wei singer, M. (Eds.), Information Center Newsletter anci 

Literature. Quarterly, 1971 - 1975 
Robinault, I. and Weisingen, M. (Eds.), PA/VR Expansion Grant Projects^Guide 

Materials. New York: ICD Rehabilitation and Research Center,, Jan. 1972 

Robinault, I. and Wei singer, M. (Eds.), PA/VR policies and Practices - joint Forms r 
New York: ICD Rehabilitation and Research Center, 1973. 

Robinault, I. and Weisiriger^ M. (Eds.), PA/VR policies and Practices - joint Forms. 
New York: ICD Rehabilitation and Research Center, July 1973. 

Robinault, I. and Weisinger, M. A tape cassette technique for vocational educa- 
tion, Reha:bilitation Literature, 1973, 34, 80-84 pp. 

Bennett, C. and Weisinger, M. Program Evaluation: A Resource Handbook for 
vocational Rehabilitation. New York: ICD-RUL, 1974,* 150 pp. 

.Bennett, E.C. & Weisinger, M. Child Foster Care, social and Rehabilitation Record ^ 
. 1975, 2 (4) 28-33. 

Weisinger, M., Robinault, I. and Bennett, C. (Eds.), Program Evaluation: selected 
.Readings, New York: ICD-RUL, 1975, 90 pp. 

Robinault, I. and Weisinger, M. implementing New service Deliye^ Techniques: 
Training Workshop. New York: ICD-RUL, 1975, 45 ppC 

' Grant Period FY June 1975 - May 1976 

Robinault, I. and Weisinger, M. (Eds.), Program planning 5 Evaluation: Selected 

Topics Fox vocational Rehabilitation, New York: ICD, J 975, 114 pp. 
ICD-RUL, Images, vewaa Bulletin, March 1976, 9:i 

Robinault, 1. and Weisinger, M, A Brief history of the' ICD Research Utilization 

Laboratory. Rehabilitation Counseling Bulletin, 1975, 19, 426-432. 

Weisinger, M., Robinault, I., and Must, J. (Eds.) Information Center Newsletter: 

Program EvaAiation in Vocational Rehabilitation, Spring 1976, V0I . 1 #1. 

Richlin, M., Weinstein, S*. , and Weisinger, M. Development of Neurophysiological 

indices of retardation: interhemispheric asymmetric of the visual cor- 
tical response. Internaiiional Journal of Neurosciences , 1976, 6 

Korein, J., Brundy, J., Grynbaum, B. , -Sachs-Frankel , G., Weisinger, M., an? 

Levidow., L. Sensory feedback therapy in spasmodic torticol lis and * 
dystonia: results in treatment of 55 patients. In Fahn, S. and 
Eldridge, R. (Eds.) Advances in Neurology, V. 14,- New York: Raven 

Grant Period FY ^ June 1976 - May 1977 

^ Weisinger, M., Must, J., Robinault, I. (Eds.), Information Cepter Newsletter: 

Program Evaluation in Vocational Rehabilitation, Summer 1976, Vol. 1 §2 
, " " \ " ^ " f'sll 1976, Vol. 1 #3 

f " /' December 1976, Vol. 1 #4 

Spring 1977, Vol. 2 #^ 

ICD-RUL-Model Module: From Hospital to Commun i ty- Rehab i fi ta ti on of the Mentally 111.. 

' In collaboration with Fountain House; Publication Pending 
Brundy, J,, W^'singer „^M. and Silverman, G.J A single system for displaying EMG 

activity designed for therapy, documentation or results and analysis ^f 
research in Foulds, R.A. and Lund, B.L, (Eds.) 

PROCEEDINGS OF THE 1976 Conference on Systems and Devices for the Disabled, 

i Regional Medical R&T Cefiter #7; Tufts-New England Medical Center, Boston. 



Robinault, 



Grant Period FY June 1977 - May 1978 • " 

MeisingerVM., Must. 0. and Robinault, I. (Eds.) Information Center Nev^sletter; 
• Program Evaluation- in Vocational Rehabilitation VO . ^ f I 
, « II » " . Vol . 2 #2 

* ' „ .. * -..< ' ' . Vol . 2 #3 * 

' -■ I. " Vol. "2 #4 . - 

K^^mt Illustrations of.iaE Approaches .to RSA Priorities FY, 1978. August 1977. 
Rol^inault. I. and Weisinger, M. Mobilization of 

■Facet Model for Rehabilitation of Post-HosP^tallzen Mer^tally 111. 
New York: ICD Rehabilitation and Research Center, 1977, 105 pp. 
Bennett, E.C., and Weisinger, M., Program, assessment, Chapter iti Gilbert Njnd 

Specht, H. Planning for ^Social Welfare: Issues, Models, and. Tasks, . . 
Englewood Cliffs, NJ> Prentice Hall, 1977.- pp. f^-f^' , . ■ harper 
I., Preface to Housing S Home. Services to Disabled, by ... Laurie, Harper 

& Row, 1977 ^ 
Robinault, I., Consulting Editor: Journal of Rehabilitation Administration,- , 

1977-79. ' 
Grant Period FY 1978 - May 1979 > - / 

weisinger, M., Cary. C and Robinault, I. (Eds.), Informat^^nter Newsletter: 
Program Evaluation in Vocational Rehabilitation 0\ . J f i 
fi .1 „ , .1 ■ \ Vol . 3 §d 

^„ I. . " \Vo1. 3 #3 < 

- i, .1 i " , Wol . 3 H 

Robinault, I.- and Weisinger, M., Mobilization of ^^^f^^^ r^^f^," 

Facet Model for Rehabi^tation of Post-Hospital ized J' ^.._.u 

" Second Edition (NIMH inclj/sions) , New York, ICD Rehabilitatio^n & Research 

Center, 1978, 131 pp'r- \- . „ Mow Ynrk 

Robinault, I. and Weisinger, M.; ?arly PJ^^ement Preparation Prograin, New YOrK, 

ICD Rehabilitation Research Center, 1978, 46 PP- . ■ 

*Teff, D., -^lac^ent-The Employer's Vie..'' , Edited by RUL, publication pending. 

Rehabilitation Literature. • • ' r T^ni^^ 

Robinault, IL, "Sex, society a The Disabled - A ^-eJop;^-^,f ^"f 

Reactions s Responsibilities", Harper & Row, 1978, 273 pp. 

Vhiiltz B- and Weisinger, M. (Eds. , Placement Preparation Program, n&H 'O^K, 
Schultz, B-jagd^weisinger..^^ ^^>^^^^^ ^^^^^ pp ^^^^^^^^^ ^ 

8 Audio Cassettes). « ^ 

Grant Period FY 19J9 - May 1980 ^ ^ , 

weisinger, M.,*Cary, C. and Robinault, IL (Eds 0 "Information Center Newsl^^^^^^ • 
Program Evaluation in Vocational Rehabilitation, Vol. 4 #1 through 

Vol. 4 #3. - ^ , 
Weisinger, M., Cary, C. (Eds.) MEU Technical Assistance Reports H ana ffj. 
Rob naSu I. Weisinger, M., and Cary, C. work Related Needs: ^" -^-^^"".^gg 
Audiov4sua1 program consisting of ah Audio cassette, 129 slides'. Trainee 
. Bookiy, Training, Guide and Script copy. * 
Robinault, ]. iTid Weisinger , M. Mobilization ^ ' ThTrd EdTtTon 
■ ^ Model for Rehabilitation of , Post Hospitalized Mentally 111. Third Eaxtion 
(NIMH additions). New York, -ICD, 1980-, 135 pp. 
Rnhirtaiilt I The Hidden ' Disability-Bereavement of Body L£>se & Adjusti^nt to 

Robirtault, I- P3^^,, publication pending. Archives of T anatology. 

ICD-RUL- selected. Abstracts on Follow-up. Subcontractor Spaniol, Spring 1980. _ 
ICD-RUL f'.Onograph-Fo2Jow-up studies: a Handbook for Hun.an Service Protessicndls 
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Subcontractor - Reagles, Spring 1,980. 
Robinault, I., Cary, C. CQmmunlty 'Resources for the 'Social ^^justme/it of Severely 
Disabled Persons: Options for Involvement, Ju\y lyoO. 
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Volume and Number: I No. I 
(SRS) 22-P-.55O6O 



Date: December, 1973 



Pages: 1 - 25^ 



The following njaterials are representative examples of the holdings 
of the RUL Information Center. Future issues of the PA/VR LriERATURE 
will contain relevant additions to the present list, as well as other 
/r^elated PA/VR subject areas. 



Since Successive issues of this publicatioh will be cumulative, and 
the entire ser:|.es will ultimately contain all of the holdings of* the 
Information Center, it is suggested" that readers keep the Issues hi 
a three-hole binder for their future reference. Researchers and V» 
practitioners are invited to indicate which of the listed topics they 
would like to see expanded or what PA/VR topics would be of most help 
to them in the next issue. 



To borrow documents listed in this issue, send a letter to the 
Information Center giving the borrower's name, address, plus the 
numbers and titles of the items requested. 



Susan D. Ahrenhold 
Infonnatlon Specialist 



Marvjln Wei^inger 

Associate Project Supervisor 
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Vol. IV No. 3 



Fall. 1974 



A COLLLCriON OF SELECTED 
PROGRAM EVALUATION 
TECHNIQUES ' 



James bitter and Don Goodyear of 
ti\e University of Northern Colorado' 
Regional Rehabilitation Research Insti- 
tute have prepared a collection of scales 
and statistical procedures tliat are of 
particular interest to the .pirogram 
evaluator in vocational rehabilitation. 
In addition to tlui discussions of chi- 
square tests, random numbers, and corre- 
lation coef f icj.ents , the handbook* con-- 
tains tests such as the '^Consumer Mea- 
surement Scale," the ''Case Difficulty 
Index," the "human Service Scale," and 
the "Work Adjustment Ratinn Form." 
Statistical procedures to be used and 
methodology and interpretation criteria 
are al L' included. 
014r-974(M) 

Uitcer, .lames . and Don L. Goodyear 

A<elKib^i 1 itat ion Lvaluat ion : Some 

Descriptors: Pro<»ram Lvaluat ion 
^ Measures 

Statistics . 



.ILASURLMC> CLIE;iT CHANGE AS A 
RtLIAbLh PUOGRA;! LVALUATION TECflNKJUL 

While almost everyone in Vocational 
Reliabilitation is dissatisfied with th^ 
raw status 26 data as a criterion of 
effectiveness, there is disagreGncnt as 
to wtiat measures should be substituted. 
fl)is mono^^raph, pifcpared by Wcsterheide, 
Lepliart, and Miller, reviews the litera- 
ture and poiTits out that the various case 
difficulty "techniques which have been 
devised often demonstr^ite little or no 
statlstica'l si?,nif icance when they are 
based only on closed cases. 

(Cpn*t. P. 2. Col. 1)^ 



NEW MANPOWER PROGRAMS 

In Aur^ust, 1974, Assistant Secretary 
of Labor, William 11. Kolberg, addressed 
the National Manpower Policy Task Force. 
The number of prime sponsors is some one, 
liundred less than was orlglnallv proiect- 
cd, primarily because of the decision of 
many eligible sponsors to join forces, 
r.olbort; also discusses manv aspects of 
the nlans th<Tt the prime sponsors have 
submitted, such as the types of trailing 
proposed, expen^diture patterns, and the 
development of programmatic goals for 
eval uat ion . n 
0U88-974 

l^olberg, Vi\ lian 11. 
Add r e ^ Co for the I.'ation al Manpower 
Pol icy Tasi^orcc Conference 
Descriptors: Manpower Revenue Sharing 
Program Planning 
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cou:;s^iNC the disadvaiN^gfd 

This paper analyzes the development ^ 
of counseling roles in experimental and 
dei^ionstration projects for disadvantaged 
yc^th. To t*he author, at least five 
distinctive counseling roles have been% 
significant: teaching; -behavior-'change , 
management; provision of socio-emotional 
support; d/icision-making, planning, and 
probiem-solving; and client advocacy. By 
analyzing the demands these roles m^^ke on 
the Counselor, it may be possible to draw 
certain suggestions for the training and 
utilization of counselors, as well as for 
the structure of the helping agencies. 
0199-969(H) 

Gordon, Jesse E. 

Vocational Counseling Functions for 
the Disadvantaged 
Descriptors : Youth 

^ Socioeconomically Disadvan- 

taged ' 
Counseling Technique's 
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IMPORTANT NOTICE TO OUR READERS 




V 


/ Because of changes in tha ICD-RUUs focus and priorities 
Jor this grant year, we are sorry to announce the suspension 
of the PE/VR' Information Center operations. This issue of 
the Ne-wsletter is the last scheduled to be published by the 
RUL. As of June 1, 1980, we mil be unable to fill any 
orders or information requests even if received prior to that 
date* HoM;ever\ ^'we are maintaining the subscriber .and 
request files so that they may be shipped along mth the 
document collection to the facility designated to continue 
tHe Information Center operations. 




> 


It has been a great sourde of satisfaction to us to be able to 
meet your needs for program evaluation information* We 
feel that we know many of you personally from tie many 
requests and orders thaV'-you *have sent. We deeRi^ regret . 
any inconvenience the ^termination of our services might \ 
^ cause to our readers* / • / 

* / 

We invite your comment on the PE/VR Newsletter or the 
Program Evaluation Information Center* While we feel our 
services have been useful, only yoti can tell us if it was so* 
Please write your comments, both positive and negative, to 
us so that w€ may share Xhem with the organization that 
will continue our services* Write to: 

Marvin Weisinger 
ICD-RUL 
340 East 24th Street 
New YorH, N*Y* 10010 









THE FIVE FOOT SHELF 

t This final issue of the PE/VR Newsletter provides o listing of books on Program ^ 

Evaluation. This is a companion issue to our first PE/VR Newsletter which also 
included such a list. The two issues together constitute an overview and update on 
the published, commercially available PE literature that may be of interest to VR 
evaluators. None of these publications are available through tifle Information 
Center, but publishers and prices are listed. In cases where the publisher is very 
small ox the item is privately published, an ordering address is provided. 
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L COORDINATING CONTRACTOR'S REPORT 



BOOK REVIEW SYSTEM IMPLEMENTED 

Read d hook jnd review it' As noied in the Ijsi issue of this 
hcw wiener !j]c WVRRFC^ is engaucd in developing j coniputer- 
i/L ] niMiK review svsicm on program evaluation, (he purpi)se 
t - 1 a>^i>>! VR evaluation [)rotessionals in theinnttuinalional 
nccdN The >>> stern fias now been unpleineniod in the tornu)! a 
^i)inputer tile PI 1 IT whiLh is aLLessjblo ihri)ugh an> standard 
v.oni})uier terminal >ith dial-u[) ca[)dbiliiies and it's in need ot 
niory b()(»k review^ The bt)ok reviev\ torniat is that ot a ques- 
tionnaire v^'hicli the reviewer tills in on the LOin[)uter The 
computer then processes and stores the intorniation It will 
aKo liave its own version ot a cari catalog with listings b> 
ke\ word, author and title 

lor tlu>se who don't have access to a\oinf)uier en wiio 
fireter liie typewriter or the pen and the I S Postal Service, 
tiie (enter is glad to accept your typed or handwritten bot)k 
reviews through the mail and w ill enter them ifito the tomputer 
liie ( enter will also be glad to send you Lopiesot book reviews 
fn mail just ask and you shall receive' In addition every 

months the (\*nier will run otl LO[)ies ot all the 'book 
reviews entered \n the past si\ months and send them to tlie 
MI I s and anyone else interested in receiving ihcmv 




Millie Thaxton. Secretary, West Virginia Reliabiiitcrhtin Research 
and Training Center, at work on the terminal for the comput- 
erized Program Evaluation Book Review System 



lor more intorniation and,ur insiruLtions contdLi Diana 
La Plate, Book Review Coordinator. West Virgmia Rehabiih 
lation Research and Training Center, Suite L. One Dunbar 
Pla/a, Dunbar, WV 25064 (The telephone number is 1304] 
766-7vl3H ) And remember - read a book - or two or three or 
tour and write d review Be the boyk good, bdd or inditferent 
the computer wants to know ^out 

MEU TAPE/SLIDE SHOW 

'Tiie West Virginia Rehabilitation Researeh and Training 
(enter, in conjuriLtjon with the si\ Model hvaluation Units is 
preparing a 10 minute tape/slide show that captures the essence 
ot the Ml I' project in a short, interesfing. convenient tbrinat 
The show wjjl be ten minutes long and feature b«th tiie joint 
activity of the si,\ Mhls and projects tliai are unique. to each 
Ml r The tape' slide show will be available tor loan t>om the 
West Virginia Rehabilitation Research and Training Center. 
Suite i . One Dunbar Pla/-a. WV 25064 Write to Harnett S 
Beury, Administrative Assistant, for more mformation Or call 
her at (304) 766-7318. 

NATIONAL CONFERENCE 
ON PROGRAM EVALUATION 

The West Viiginia Reliabiiiiation Research and Training 
(enter is sponsoring a National ContcrenLe on Program I valua- 
tion. Decenihdr 14-17. 1980. at tlie IloterHiilon in New Orleans. 
Louisiana The purpose of' the LonfereriLe is to share the knowl- 
edge gained under the Model I valuation Unit contracts with 
the rest ot the 50 states and the U S territo/ies. There will be 
workshops, seniinais, lectures, audio-visual presentations. panel 
discussion?! dud peei collaboration sessions Theie will be ses- 
sions aimed specifically at small states. mecioini'Sye stales, and 
large states. It will be a smorgasbord of new ideas, technicjues 
and methodologies from which the participants can pick and 
choose to meet* their ()articular needs Nan Bren/el. l-d.D., 
IS conference chairman for more information contact her at 
the West Virginia Rclubilitation ResearcTtand Training Centei. 
Suite I . One Di\nbM Pla/a. Duribai. W^V 2^066 The teleph{)ne 
number is 766-7 138 
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Mr. iiarJdn.Weisinger' 
Director, ^Information Center 
Research Utilization L^oratory 
ICD Rdiabilitation and 'ReSsearch 

Center > * ^ • f 

340 East;>24th Street ^ 
New York, N.Y. 10010 

•r 

Dear Mr. Weisinger: 

We are in receipt\of your August letter, and^we regret 
to learn that your organization has decided to suspend t±ie 
FE/VR Information C€nter»operati9ns . 

We always view any closing of an information service as^ 
a gre^t loss to all who rely on it fcjr current knowledge. As 
decision-makers, managers, practifcioners , clients and the ccran- 
vrdty at large ar^ beconing increasingly aware of dieir need 
for current information in order to perform ncre effectively, 
we view cutbacks and shut downs as a step badcwards in the age 
of technology. We suspect ecaxnrLcs pl^ed an inportant part 
in the decision to tertninate your service, if so, it is deeply 
regrettable. ' 

Your Program Evaluation service was particularly useful 
to us. As you laiow, very recently, the fields of health and 
social welfare &ve begun to place heavy ftiphasis on program 
evaluation. Without a long history and a store of knowledge 
on the subject, we. have relied upoa two primary ^sources , die 
federal gpvemment's Project Share and your newsletters to in- 
form us of the trends , progran developments and availability 
of materials in this area. Ydurs was TOre than a useful ser- 
vice, to us, it was -essential. ' * ^ 

We sincerely hope that you will pe successful in your 
attaipts to persuade your organization to continue PE/VR .news- 
letter and the Program Evaluation Center. 

^ We thank you for all of your efforts of the past. . 

SincerdLy, 



V 



GID:ks 



Gwendolyn T. Davis 
Infontation Specialist 
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The PPP consists of ten group session^/ 60 to 90 
minutes each. It is suggested that the group leader 
be a professional counselor. Eight of the sessions 
are accompanied by audio-tape cassettes ranging 
from two to sixteen minutes The i;emaining two ses- 
'sions use various types 'of handouts and^naterials, 
samples of which are included. Although'designed 
mainly for clients already in training, PPP can be 
helpful for those in prevocational, aqd workshop 
programs. It can be used '^Iso for the de^f, with 
specially/ prepared transcripts of the tapes. A shor- 
tened and more^structured version can be used 
successfully with mentally retarded clients. PPP 
daVi be used as a training tool for counselors. 



IWhy People Woric— Why People Doh't Work > 
i ^ 5 p^io 25 sec ( « 
4 gfoup of Clients talk about \Nhy they have chosen to 

/^ork Of not sNOfk 

S'Hce PPP begins early m the clients rehabilitation program il is 
essential t*^ai the first session help him explore hts expectations of 
what going to work will mean In group discussions, the client* ^ 
-^ofoup ts allowed to express their own reactions freely, their rea- 
s5^s for wanting to work and their reasons why income from 
Socai Security Disability Benefits Veterans Pension of othe< 
sources make them hesitant to go work 





2 Worker Responsibilities: Good Work Habits 
( 7 rn,f^ 11 sec > ^ , ' 
A discussion ts p^sented bet\^een an employer and a 

Dew employee who has bet^n called m because of excessive late 
nesses absences and mapp^nate dress • / y 
i'''e discusbion group is «^rn,ouraged to commit on dwar^ness X 
and acreotance of personal responsibilities and aemands of a pb ^ 
T^e need to establish acceptable work habits anr>^ttitudes early \n 
•he tramtng orogram is eonphasized An understanding of the 
cen* s fesponstbiiif y to himself and to his employer is 
encouraged • . ^ • ^ ' 

Worker Responsibilities: Productivity ^ 

f9 nnin 24 seC ) ' * 

A Situation is dramatized to help make clients a^^areof 
work^standards 'specifically the quantity^Qf^ork expected regu- 
tariy The review of \^jojk habits ^hich enharlce or interfere with 
production also ts examined 

* ^ 
Getting Along on the Job : 
Co-Worker Relations (2 mm 15 sec) 
A confrontation ts presented between a new employee 
and a seasoned worker, the new empjoyee complaining of being 
shut out by the older employees 

The client-group is urc;ed to discuss j/arious aspects of peer rela- 
tionships on the job TTie importance of maintaining satisfactory co- 
worker relationships js stressed Clients are asked to attempt to 
solve problems which could occur on the job through role-playing 

Getting Along on the Job: ' 
Supervisor-Employee Relations (3 mm 5 ) 

TTh^ <>ession dramatizes a situation ^which is rather 
complex and has no Uear cut resolution A supervisor requests 
some work from an employee on her ownl^me without compensa 






tion Whiie*^ certain amount of problem solving is attempted dur- 
ing the presentation the situation is left unre^ved 
Clients a''e"as^Pd to conrifTient on oosstbie resoiuiions Th^y exam 
me a wide range of potential super vtsor-c-nnpioyee interactions 
The focus IS on the resolution of disputes wif'- '^uftiC'ent tact to 
Keep the work b'luafion operational 

Fears Related to Going to Work 

(7 mm 55 sec ) 

A conversation takes place between an individual 
ready to go on job interviews, after a period of hospitalization for 
emotional problems, and his friend, an older established worker 
/^hOfis an ex-offender and an alcoholic The new worker voices his 
fears about his ability to function on the job and his concerns about 
revealing his past hospitalrzation 

Clients are urged t^vo*ce their own fears about going^to work 
Hpw to Get There: Personal Qualifications 

(3 mm 43 sec ) 

An interviewee "sells herself" by describing her *iktlls. 
training and persorial attributes related to work 
Clients are helped to recognize personal qualifications— r e . skills, 
attitudes* to prepare self-mventories and th^ receive group 
feedback , ^ * 

How Do Ybu Get There: Application Forms 

(no tape) 

By examining sample application forms clients are 
belped te understand the nature and reasons for questions asked 
on the form 

Interviews dOmm^sec) 
Two interviews are presented In the Jirst, the inter- 
viewee has a very posihve view and attitude, handling 
questions of breaks m work history irfe constructive manner In the 
\econd. however, the prospective employee is evasive^ becomes 
trapped m a he and loses his temper 

Although cc5mparisons between th'fe two interviews are extreme, 
the nature of an interview and the need for careful preparation are 
* the focus of this session 

How Do Yoiu Get There: * 
J6b Hunting Techniques (no tape) 
tTha 'When. Where and How" of job hunting are dis- 
cussed in dfeta^ Sample want ads and a dictionary of abbrevia 
lions are stuot^d 






'ICD % 



We, at the Research Utilization Laboratory would ve/y much like to know your reactions to 
the program, Work Related Needs: An Introduction. 



Since it'is our purpose to supply professionals with the most useful kinds of materials and publi 
cations, the feedback you provide will be helpful in determining whe.ther the present prbgr^m 
should be modified to moreclosely fit your needs and whether we should prepare additional 
materials such as this in the future. 

^ This brief questionnaire, when completed, can be enclpsed in the accompanying business reply 
^ envelope and dropped in'the mail -» no postage required. 

May we hear from you soon? . . 

1 . How would you characterize the major way you spend your professional wof k time. ^ 

^ Research and/or CtAdminist/'ation □ Diree^ Service 

and Supervision ► Provision 

□ University Teaching □ Other 

(Please Specify)^ 
Department • 



Evaluation 
n Training 



2. What-is your overall reaction to these materials' 

) □ Very □ Somewhat □ Neutral 
Negative Negative 

3. how would -you "grade" the materials on the following dimensions? 



□'Somewhat 
Positive 



□ Very 
Positive 





Format 


Urbanization of 
the Material 


Relevance of. 
Infornnation 


Clarity 


Usefulness 


Booklet 












Narration 










* 



(Note: Grade each AB.C.D. or f . If the grade you give is lower than B on any dimension would * 
you please add comments below that might help us understand what lies behind your judgement) 



' * ~ ^ * t 

4. How would you grade the ^€chnical quality of the materials? (Grade and comment as above) 



Cassette tape 


Slides 


Trainers Guide 


' ' Booklet 

>^ 








^ , 



5, Have you (or do you expect to) put these materials to use in your own work, or in the activities 
of your colleagues or your organization? 

□ Not at all , □ A little □ Quite a bit □ A great deal 
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strive to meet them. ill result in' a higher level of 
rehabilitation than wnl setting goals completely ^ i,lhm 
the client's capacity ^ 

1r counseling the mentally dibabled. there are several dif- 
ficulties with these stances We first starue. reality onenlalion, 
Ignores the fact that few peopJe — disabled nr nondisabled — 
realize their maximum poicniial The seci^nd stance,' accep- 
tance, assumes ai? unchanging cimditinn Thu'^ it would fit many 
physically disabled clients, but fewer mentally disabled clients , 
since the course' of mental illness is difficult to predict The 
Spartan attitude, the third stance, is tine for clients who aren't 



APPENDIX 0 

*try ing and need ' 'bucking up. ' ' However, the mentally disabled 
client may find the constant urging a source of additional anxiety 
— hardiv a desirable condition to foster. 

The counselor shouljd beware any overgeneralized approach 
that does not keep in mind individual characteristics and indi- 
vidual needs, >s nece^ary to assess the needs of each client 
and determine how, wheb, and by whom each need should be 
met Part of good counseling consists of inierpreiing the coun- 
selor s knowledge to the client, oneniing the client to the com- 
munity, and providing necessary concrete services, including 
PES. ' • / ' • 



Community Care Handbooki 



Community care tor deinstiiulionali/ed mental pa- 
tients i> the subject of a handbcMk b> Isabel Robinaull and 
Marvin \^eIsInge^ot the ICD Research Utilization 
)| Laboratory The handbooks C^>mmi/^i/r\ Resources 
Muhi'Facei Model for Kieniulh III illustrates ways indi- 
vidualized client services (.an be obiamed through a com- 
bination of interagenc) eflorts 

This mtxiel has ihice aspeus living arrangements, 
socialization, and prepjraiion tor work The three hon- 
zontaf units ir\each cateaurv illustraie the continuum from 
semi-dependency to sunp^^rted independence 

' The rest of the handbook descnbes tacililics that oper- 
afe as halfway houses or as program prototypes in living 
independently, socialising. orv.orkmg It gives name and 
location for these facilr.es. which ^an serv e as models tor 
expansion or for dev^lnpment ol local tacilities The ap- 



pendices list the facilities alphabetically and provide 
examples of interagency agreements (For more informa- 
tion on interagency cooperation . see REHAB BRIEF Vol. 
11, No. 3.) ^ 

Some possibilities of the handbook's use are 

• to identify or categorize existing community re- 
sources (including population served, costs, and 
staffing options). 

• to match client needs with community resources, 
•'to mobilize development of community resources 

■ #10 fill unmet needs 

For information on ordering the handbook, contact 
Dr RobinaukorMr Weisinger at the Research Utiliza- 
tion Laboratory. ICD Rehabilitation & Research Center, 
340 East 24ih Street. New York.J^IY 10010. Phone: 
212-679-0100. 



A Model for Post-Hospitalized Mentally III Clients 









Supported 
Independence ^ 




Semi 
Dependent 

<a 


* Semi 
independent 


Living 

arrangements, 
dailyMiving 


1) Hospital, 

work/release unit, 
home (as dependent) 


2) Sijpcrviscd 
community 
group residence 


3) Home (as contributor) 
own housekeeping 
own apartment » 


Socializing 


1) Therapy group 


2) Organized 
recreation 


3) Sclf-sclcctcd: hobbies, 
church, sports, etc. 


•Work/ work 


f) Work evaluation 


2) Work training 


3) Placement < 


preparation 


EXAMPLES OffesiBLE MIXES 



I - I -1 Pre JisduH-ge prepardli(*n program on 
hospital ground or re(.enlly discharged home 
on drug maintenance 

1 • I -2 Lsmg hospital as home base and going 
mtocomm-jnity tor>iork preparation or OJT 



2 -3 -2 Trdnstiiondl program at rehabilitation 
center while living in a supervised group resi- 
dence. 
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2- 3V3. Living in group residence attending Y 
at night for painting hobby and in first job or 
OVR placement. 

*3-*3-2l5^Living at home as a contributing 
member, attending church or synagogue, in 
last months of computer training course. 

3- 3-3. Own apartment found through halfway 
house, goes to sports events with friends^ is at 
work in fib compatible with skills and in- 
terest, continues therapy voluntarily. 

REHAB BRISP Vol,Il,:;ot6i 
August 10,1979 
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DEPARTMENT OF HEALTH, EDUCAflON. AND WELFARE 
PUBLIC HEALTH SERVICE 
ALCOHOL. DRUG ABUSE. AND MENTAL HEALTH ADMINISTRATION- 



April.n, 197? 



THE STAFF COttEGE 
NATIONAL INSTITUTE OF MENTAL HEALTH 
5635 FISHERS LANE 
ROCKVILLE, MARYLAND 20t52v 



i 
4 



Isabel P. Robinault^ Ph.D, 



Research Utilization Laboratory 

ICD Rehabilitation and Research Center 

340 East 24th Street 

New York, NY 10010 



UC.D 



Dear Dr. Robinault: 



This is to reques 
for Rehabil i tatio 
we had requested 
pants in a Staff 
lication has been 
appears advisable 
College course en 
Community. " 

We would apprecia 
we can ensure tha 



t 100 copies of "Community Resources: A Multi-Facet Model 
n of Post-Hospitalized Mentally 111." You may recall, 
copies of your publication for distribution, to partici- 
College* course on Deinstitutionalization.^ Since the pub- 
well-received by participants in that course, it now 
to make it available \o participants in another Staff 
titled: "Vocational Workshops: Rehabilitation in the 



te your cooperation in expediting this request so that 
t the materials are distributed by the middle of May. 




,y6incei:^ely, 



-4 



Isabel Davidoff 
Assistajrit Director-Registr 
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prtcticcd in public and private agencies only when 
counselors are familiar with the principles of inde- 
pend^t living. Describing rehabilitation tor inde- 
pendent living a.s a complementary network of 
services — mirfatcd at the onset of disability and con- 
tinuing throughout life — that mcrease options and 
develop decision-making ability, this article discusses 
the preservice training of rehabilitation counselors 
dcsignecl to prepare them for counseling in this area. 
The pertinent skills of advocacy, job re-engineering, 
communication, and use of community resources 
were taught in the educational programs that were 
evaluated, other useful area5 of knowledge^-th»c were 
not addressed, such as sexuality and assVf(j\4ness 
training, are indicated Recommendations are made 
for improving curriculum m independent living, in- 
cluding internships in centers where, this concept is 
practiced, and the importance of instructors and ad- 
ministrators* commitment to this form of rehabjjifa- 
tion IS emphasized 



INDUSTRIAL HYGIENE 
See 453. 

MATERNAL AND INFANT CARE 
Seep. 300. 

V 
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441. ICD Research Utilization Laboratory 

Comniuntt) resources for the social adjustment of se- 
terely disabled persons. Options for intoliement, by Isabel 
P. Robinault and Caverice Gary. New \iork. The 
Laboratory, 1980 iii, 136 p. paper. 
' Before handicapped persons can obtain employ- 
c ment and achieve independcnce-in other areas of hfe, 
they 'first must make appropriate social and personal 
adjustmenrs. To assist rehabilitation counselors and 

* self-help groups in providing* opportunities for self- 
fuilfilmcnt and the development of social skills for 
disabled persons, this booklet presents examples of 
resources throughoui the country focused on selt- 
directcd functioning The resources are grouped 
ac^rdin/f to 6 ma)or categories: socialization and lei- 
surcv^scxtrahty, hobbies and education, consumer 
advocacy and volunteer action, recreation, and trans- 
portatioin and travel. The programs and sources of 

* information are described in a concise and informal 
narrative style focused on the concerns of handi- 
capped persons, knowledge gained from recent re- 
scaroi; and noteworthy innovations. The abstracts 
document what has been done in this field and 
suggest areas for future endeavors. Each section con- 
tains a referenced introduction, pertinent excerpts 
from the literature, and addresses of relevant pro- 
grams and publications. Among the 7 appendixes are^ 
a test for assessing pcrspnal acfjustment, a scale toi 
rating interest and participation in activities, and gen-^ 
era! driving aid requirements according to, residual 
functions. This unique booklet should serve to foster 
creative growth, personal freedom, and greater en- 

^ joyment of hfe among disabled persons. 

Copies of this publication are available for S6.00 
from Book Orders, Research Utilization Laboratory, 
ICD Rctiabilitation and Research Center, i-iO E. 24th 
St., New York, N.Y. lOOlO 
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MENTAL RETARDATION 
See AM, 

MENTAL RETARDATION— LEGISLATION 

442. U.S. Presid^t's Committee on Mental Re- 
tardation 

Mental retardation Jfiid th^aw, A report on status of 
curunt court cases, Washir^^n, D.C., The Committee, 
1980. 51 p. paper. ' 

Prepared by the B^ton University Center for Law 
and Health Scieme€s, this booklet reviews court cases 
of recent yearvuiat have mvolved persons with men* 
tal retardatK><v The first part of the volume provides 
summarie/of over "^5 cases heard in U S. courts con- 
cerninfi^mmitment, community living and services, 
criny<ial law, discrimination, guardianship, institutions 
ar^a demstiiutionalization, medical issues, parental 
i&igftv and sexuality, and special education. Refer- 
ences to previous reports on the cases are included 
The latter half of the text is made up of an article on 
the sterilization of persons T^ith mental retardation 
Historical information, a legal analysis of sterilization, 
and procedures .ind standards applicable to a specific 
case regarding involuntary sterilization are presented. 
Some of the issues addressed in the article are the 
constitutional rkht of procreation, eugenic )ustifica- 
tions'for steriliAc mentally retarded persons, fitness 
for parenthood,^nd less restrictive alternatives- to 
sterilization- 
Copies of this publication (Stock So. 017-000' 
00203-1} arc available for SI. 50 from the Superin- 
tendent of Documents, U S Government Printing 
Office, Washington, D.C. 20102 ^ 



MENTAL RETARDAT 
EDUCATION 

See 403. . 
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MENTAL RETARDATION— SPECIAL 
EDUCATION 
See 402. 

MULTIPLE SCLEROSIS 

443, Hawkes, C. R 

Stimulation of dorsal column in multiple sclerosis, 
by C. H. Hawkes and others. Brit Med. J: Mar. 29, 
1980. 6218:889-891. 

The effect of st&Mi^^mjS the posterior section of 
the spinal cord' in I9^ected patients with multiple 
sclerosis was st idied mVictail over 2 weeks. Evalua- 
tions conducted before and during stimulation were 
clinical neurological examinations, videotape record- 
ings of movement, psychomotor testing, clectrolaryn- 
gography, and urodynamic studies. Improvement was 
evidenced by a number of patients in walking bpecd, 
power of certain muscle groups, relief of Chronic 
pain, and bladder function Since the motor im- 
provement was thought to be related to the effects of 
high motivai;ion and practice, the significance of dor- 
sal column stimulation in these areas was questioned. 
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